bannera

Book A.
Introduction

Book B.
7150 Requirements Guidance

Book C.
Topics

Tools,
References, & Terms

SPAN
(NASA Only)

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

Software Acquisition

Purpose

This document discusses guidance for projects implementing the NPR 7150.2A requirements addressing software acquisition, including SWE-015, SWE-032, SWE-033, SWE-037, SWE-038, SWE-045 through SWE-048, and SWE-102Lee,
Possible tags for this topic would be those for the SWEs listed here and id'd in the SMARTS tagging scheme in review w/ Kevin.
Summary would include:
Responsible Org: Project Manager (maybe other roles from section 2 below)
Milestone Reviews: SAR, MCR, SRR, SWRR, MDR, SDR, PDR, CDR, PRR, TRR, SIR
Documents: Analysis, Plans, Reports
Classes: All except H (if SC=safety critical & NSC = Not safety critical, the list would be: A SC, A NSC, B SC, B NSC, C SC, C NSC, D SC, D NSC, E SC, E NSC, F, G
You might want to discuss this with Kevin to be sure I interpreted his guidance correctly re: using SMARTS tags and see if he agrees with adding the Roles from Section 2 as tags.
. This guidance is intended for all persons responsible for the software acquisition process from the planning stages through contract close-out.

Roles

Role

Responsibility

Project Manager

Approve procurement plan

Software Project Lead

Prepare procurement plan, prepare SOW software requirements and software data requirements for the contract, monitor execution of contract

System Engineer

Conduct trade studies, engineering analyses

Contracting Officer (CO)

Prepare contracts

Contracting Officer Technical Representative (COTR)

Prepare contracts

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="0ab1521a-593d-456b-91d2-cce5760de681"><ac:plain-text-body><![CDATA[

Software Technical Authority

Prior to contract release verify that the SOW includes the complete flow down of the agency and center software requirements [recommended practice]

]]></ac:plain-text-body></ac:structured-macro>

Planning

Before software acquisition can be carried out, a need requiring a solution must be identified. During the planning stage, various solutions to address the identified need are evaluated with the following possible options:

  1. In-house development/service
  2. Contracted development/service
  3. Acquire OTS product
  4. Use/enhance existing product/service

If the solution to the need will involve software, NPR 7150.2A applies and the acquisition planning guidance below should be applied:

  1. Define the scope of the system of interest.
  2. Identify the goals and objectives for the software portion of the system.
  3. Identify the technical requirements (functional, operational, performance).
  4. Perform "make or buy" market research/trade studies to determine if an off-the-shelf (OTS) Hover-over acronym define.solution exists:
    • Establish criteria (and a plan) for the studies:
      • Technical requirements
      • NPR 7150.2A classification
      • Constraints and limitations (cost, schedule, resources)
      • Use past studies, known alternatives, existing make/buy criteria
    • Conduct studies.
      • Assess potential products and technologies
      • Assess how well technical requirements are addressed
      • Assess estimated costs, including support
      • Identify risks (delivery, safety, development practices used by supplier, supplier track record, etc.)
      • Assess provider business stability, past performance, ability to meet maintenance requirements, etc.
    • Identify in-house capabilities to meet the need:
      • Assess availability of existing products which could meet the need or be modified to meet the need
      • Assess availability of qualified personnel for development or modification activities
      • Assess estimated costs (time, personnel, materials, etc.), including support
        • Use past projects as basis, where appropriate
      • Identify risks
    • Determine if solution will be custom made, an existing product, or a modified existing product.
    • Review COTS/GOTS/MOTS guidance in NPR 7150.2A handbook for additional guidance and considerations. link this to our COTS/GOTS/MOTS section in the wiki
  5. Identify any acquisition risks based on requirements and "make or buy" decisions.
  6. Create at least one government software cost estimateLink this phrase to SWE-015 for this work.
  7. Document analysis:
    • Expected classification of the software to be acquired
    • Availability of in-house staff and funding resources
    • Availability of the software product(s)
    • Projected licensing and support costs
    • List of potential suppliers
    • Security considerations
    • Potential risks related to supplier's viability and past performance
  8. Document solution choice and basis for that choice:
    • Estimate of in-house vs. acquisition costs (including OTS solutions and any associated costs for requirements not met by the OTS solution)
    • Comparison of cost estimates to available funding and to the government software cost estimate
    • Risk assessment
    • Assumptions, observations, rationale, determining factors
    • Significant issues, impacts of each option
    • If solution is in-house development/service, exit this procedure
    • If solution is to acquire product/service, continue tailoring as needed based on development under contract or purchase OTS solution
    • Other planning decisions resulting in best overall value to NASA
    • Description of chosen acquisition strategy
  9. Identify stakeholders based on requirements and "make or buy" decisions:
    • Those directly concerned with, or affected by, the acquisition decision.
    • May include management, the project team, procurement, customers, end users, and suppliers.
  10. Ensure acquisition team includes organization from NASA (acquirer) with appropriate (see SWE-032Link to SWE-032) non-expired CMMI rating as measured by a Software Engineering Institute (SEI) authorized or certified lead appraiser*
  11. Report analysis and resulting decision to appropriate stakeholders.
  12. Document lessons learned for future acquisition activities.
  13. Develop acquisition schedule, including solicitation, supplier selection, supplier monitoring, and product acceptance and transition to operations, as appropriate.
  14. Develop acquisition plan using center-specific template.
    • When a project acquires either class A or class B software, at a minimum, personnel from an organization that has a non-expired CMMI Maturity Level (ML) 3 or ML2 rating respectively, in the Supplier Agreement Management (SAM) process area is required to support the acquiring organization during the acquisition planning process in the software area.When a project acquires either class A or class B software, at a minimum, the acquiring organization is required to be supported during the acquisition planning process, in the software area, by personnel from an organization that has a non-expired CMMI Maturity Level (ML) 3 or ML2 rating in the Supplier Agreement Management (SAM) process area. This is a long sentence. I tried to make it easier to follow by changing it from passive to active voice.

      KDM: Lee,
      This text was provided by Tim Crumbley and/or John Kelly and is one of the reasons this has taken so long to get to this point in the review cycle. I'm hesitant to change it much at all. In spite of its length, given that the sentence you changed was revised a few times during those discussions, I think it should be retained as originally agreed to by John and Tim.

      LAJ: Since this needs to be reviewed by John Kelly again, I think I will leave it and just not approve the change. John, if you don't mind, please review my edit and approve or reject the change. Thanks!

      Lee,

      This one was primarily edited by Tim, so it would be his approval that would be key here. John does have the final say, however. ?

      Do know that Kevin and I had Tim on a teleconference to discuss this text before it was okayed to come back to you. Kevin, Tim, and I worked this sentence quite a bit during that teleconference before coming to agreement on what we had. This ensures the project is supported by a smart buyer that is knowledgeable of best software practices associated with CMMI resident within the supplier's engineering capability. This SAM-only alternative allows a Center or prime contractor who might only procure small amounts of class A and class B software, and who may not have a full CMMI ML2 or ML3 rating, to acquire this type of software and to participate in a project that requires its use.

    Solicitation, Selection, Award

    Once the planning activities for software acquisition have been completed and the decision has been made to acquire the software or software development services, the team needs to follow a selection process to choose the best provider for the project. This process typically begins with development of a Statement of Work (SOW). Hover-OverThe following recommendations should be considered as part of this process. Additionally, a SOW checklist reference is included in the Tools section of this guidance document.
    1. Develop solicitation, including SOW:
  • Acceptance criteria
  • Solicitation constraints
  • Proper requirementsSWE-048 from the software development perspective*:
    • Software classification (from NPR 7150.2A) and safety criticality (from Software Safety Litmus Test)
    • Technical requirements
    • Development standard to be followed, if any
    • Development lifecycle to be followed, or indication that developer can choose appropriate lifecycle
    • Surveillance activities (and acquirer involvement) including monitoring activities, reviews, auditsSWE-045, decision points, meetings, etcSWE-039.
    • Management and support requirements (project management, schedule and schedule updatesSWE-046, configuration management, non-conformance and change trackingSWE-043, risk management, metrics collectionSWE-044, IV&V support, required records, traceability records, electronic recordsSWE-047 in conjunction with other text in the list and code accessSWE-042, V&V, etc.)
    • Requirements for maintenance, support, updates, new versions, training to be included in lifecycle and cost estimates
    • Concise task and deliverable descriptions, including delivery formatSWE-040
    • Media format for code deliverablesSWE-040
    • Templates or Data Item Descriptions (DID) Hover Overfor documentation deliverables
    • Complete set of deliverables with delivery dates, review periods, and acceptance procedures for each
    • Time period for responses to review findings, including making changes
    • Data Requirements Documents for deliverables, if appropriate
    • Government and contractor proprietary, usage, ownership, warranty, data, and licensing rights, including transfer
    • Requirement to include notice of use of open sourceSWE-041 software in developed code
    • OTS software requirements (identify which requirements are met by OTS software, provide OTS software documentation such as usage instructions, etc.)Link to COTS/GOTS/MOTS
    • List of all mandatory NASA software development standards and DIDs, as applicable
    • Requirements for non-expired CMMI rating as measured by a Lead Appraiser certified by the Software EngineeringSWE-032 Institute (SEI) authorized or certified lead appraiser (see the Useful ToolsLee,
      If you want to insert a hyperlink to section 9.1 of this document (or wherever it ends up on the Wiki), feel free to do so. section below for sample text for the solicitation)


*Acquisition should not simply levy NPR 7150.2A as a whole on a potential supplier, as it contains some NASA institutional requirements.. If a project is acquiring software development services for class A through H software, the project should only levy the applicable minimal set of supplier requirements , plus additions that address specific risk concerns. Requirements that are the responsibility of the Agency, center or Headquarters should not be levied on a contractor as they will cause confusion and unnecessary expense.

If the class of software and the safety critical designation are known when the SOW is written, the project can levy, via a compliance matrix, the project/system specific set of NPR 7150.2A requirements to be satisfied by the contractor. If the class and/or safety critical designation are not yet known, the SOW should list applicable requirements for each class and safety critical designation with instructions to comply accordingly when a class and safety critical designation are determined.

In the case of requirements marked P(Center), the responsible NASA Ccenter and project supply the applicable elements of these requirements for inclusion in the SOW.

The full list of project related requirements can be found in the compliance matrices found in this handbookLee,
Please add links to the page in the handbook that contains the compliance matrices that Kevin created for each software class once those matrices are added to the handbook. Suggest changing "compliance matrices" to a hyperlink to that page in the handbook.

LAJ: Noted..

.xuirements riticality (XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

    1. Ensure proper review of SOW before delivery to procurement/contracts official:
  • Technical Authority to ensure proper flow down of NPR 7150.2A requirements
  • Coordinate with the Safety and Mission Assurance Office to ensure all QA requirements, clauses, and intended delegations are identified and included
    1. Identify potential suppliers.
    2. Distribute solicitation package.
    3. Evaluate proposals (typically an evaluation team), based on selection criteria, including:
  • Cost estimation comparisons
  • Evaluation of how well proposed solutions meet the requirements (including interface and technology requirements, NPR 7150.2A requirements)
  • Staff available
  • Past performance
  • Software engineering and management capabilities
  • Prior expertise on similar projects
  • Available resources (facilities, hardware, software, training, etc.)
  • CMMI ratings
    • Check the SEI Published Appraisal Results (PARs) to confirm non-expired rating (http://sas.sei.cmu.edu/pars)
    • Be sure to check the scope of the organization holding the CMMI rating to confirm the rating is held by the specific organization submitting the proposal
  • Etc.Other factors relevant to the project
    1. Select supplier/contractor and document basis for selection.
    2. Negotiate and finalize contract:
      • Based on SOW
      • Identify and include management reviews and meetings, such as:
      • Formal reviews, such as those found in NPR 7123.1
      • Technical reviews
      • Progress reviews
      • Peer reviews (see Software Peer Reviews and Inspection topic guidance in this handbook)
      • Software quality assurance meetings
      • System integration test and verification meetings
      • System safety meetings
      • Configuration management meetings
      • Other relevant review for this projectEtc.
      • Consider for inclusion in contract provisions (description of the method to be used) for verification of
        • Contractor handling of requirements changes
        • Accuracy of contractor transformation of high-level requirements into software requirements and detailed designs
        • Interface specifications between the contractor's product and systems external to it
        • Adequacy of contractor's risk management plan and its implementation in accordance with the required activities in the project Software Risk Management Plan
        • Adequacy of the contractor's integration and test plan and its implementation in accordance with the required activities in the project Software Integration and Test Plan
        • Adequacy of the contractor's configuration management plan and its implementation in accordance with the required activities in the project Software Configuration Management Plan
      • Consider for inclusion in the contract the content and frequency of progress reports and metrics submissions
      • Consider for inclusion in the contract identification of quality records to be maintained by the supplier
      • Consider for inclusion in the contract the delivery process and how it will be accomplished; if incremental development and delivery agreed upon, state how the validation process works (e.g., incremental validation) and whether it requires integration and test with software/hardware products developed by acquirer and/or other contractors or organizations (other institutes, universities, etc.)
      • Consider for inclusion in the contract a policy for maintaining the software after delivery: who is responsible for maintenance of the software, tools, testbeds, and documentation updates

Monitoring and Quality Assurance

Once the provider has been chosen, the acquisition process moves into a monitoring role. The following guidance should be included when establishing the process for provider monitoring and quality assurance:

  1. Provide technical requirements interpretation for contractor.
  2. Ensure contractor requirements documents meet original intent.
  3. Evaluate contractor progress with respect to cost.
  4. Periodically monitor contractor skill mix to ensure agreed-upon skills and experience levels are being provided.
  5. Oversee government-furnished equipment (GFE) Hover overrelated to the development of software to ensure equipment and information provided in timely manner
  6. Periodically assess contractor processes to ensure conformance to process requirements stated in the contract
  7. Review and assess adequacy of contractor-provided documentation and ensure contractor implementation of feedback; consider using Formal Inspections to accomplish this task. Track status considering the following example questions:
      • Is the contractor meeting their staffing plan?
      • Have the project and the contractor met the user's needs?
      • Does the contractor have stable, educated staff?
      • Does the contractor's project have adequate resources (e.g., adequate staffing and computer resources)?
      • Is there realistic planning/budgeting in place?
      • Is the build plan being met?
      • Does the contractor have a good understanding of what is required?
      • Are the requirements stable?
      • Is the completion of designed functionality visible?
      • Is the evolving capability and performance of the contractor's product likely to impact development on the acquirer side of the interface?
      • Are integration and testing proceeding as planned?
      • Is contractor cost/schedule performance on target?
      • Is contractor developing a quality product?
  8. Provide regular status reviews to higher-level management on contractor progress.
  9. Regularly assess status of identified risks and provide reports during management reviews.
  10. Software engineering should provide technical review to the level required to enhance the probability of mission success (see the Useful ToolsLee,
    If you want to insert a hyperlink to section 9.2 of this document (or wherever it ends up on the Wiki), feel free to do so. section below for a list of areas to consider for software engineering technical review).

Contract Administration

In addition to monitoring the selection provider's progress and quality, contract administration activities are also carried out for the project. The following guidance should be included when establishing the process for contract administration:

  1. Regularly assess contractor financial data and invoices against budget.
  2. Work with Contracting Officer to ensure timely resolution of any contract-related issues.
  3. Work with Contracting Officer to ensure timely address of needed modifications to contract terms and conditions, as needed. Of primary consideration are those affecting schedule, costs, services/products, resources (people, facilities), deliverables
  4. Periodically evaluate contractor performance in manner consistent with contract and provide documented evaluation to Contracting Officer.

Product Acceptance and Control

Once the provider is ready to deliver the software product, the acquirer should have a process in place for review and acceptance of the product. The following guidance should be included when establishing the process for product acceptance:

  1. Review deliverables based on agreed-upon acceptance criteria (or generally accepted standards if specific no criteria has not been established), document results, and work with contractor to resolve acceptance issues.
      • Typically, an acceptance test plan is created addressing the following:
          • Acquirer and contractor roles and responsibility
          • Defined Test Strategy
          • Defined Test Objectives
          • Defined Acceptance Criteria
          • Developed Test Scenarios
          • Developed Test Scripts
          • Developed Test Matrix
          • Time and Resources Estimate
          • Approval Cycle
          • Strategy for post-delivery problem resolutions
      • Once approved, the test plan is executed and results are documented:
        • Select Test Tools
        • Select and Train Team Members
        • Execute the Test Plan (Manual and Automated Methods)
        • Track Test Progress
        • Regression Test
        • Document Test Results
        • Resolve Problems
  2. Place formal deliverables under configuration control.
  3. After acceptance of delivered products, support transition to an operational and/or maintenance environment.

Contract Close-Out

Contract close-out is the final acquisition step. The following guidance should be included when establishing the process for contract close-out:

  1. Verify satisfaction of all contract terms and conditions, considering the following sample questions:
      • Has the contract period of performance expired (level of effort type contract)?
      • Have all deliverables been delivered (completion type contract)?
      • Have all Contract Data Requirements List (CDRL) Items been delivered and accepted?
      • Was the contractor's performance of the SOW acceptable?
      • If the contract involved patent rights, has the final patent report been filed?
      • Has the final invoice been received?
  2. Verify return of all GFE, as appropriate.
  3. Complete final reports as requested by Contracting Officer.
  4. Provide final contractor performance evaluation to Contracting Officer.
  5. Capture Lessons Learned, if not captured earlier in the project lifecycle.

Useful Tools

The documents below are tools collected from various Centers that work well and produce good results. They are included here as aides for carrying out the software acquisition process.

CMMI Rating Language for RFP

If a project wants to procure the development of class A, B or C software, they must levy the associated requirements for which the project has responsibility and also clearly specify that the contractor meet CMMI maturity level requirements associated with the class. Below are examples of wording that could be used in a statement of work to describe the CMMI maturity level requirements:
For class A software:
The contractor responsible for the acquisition, development or maintenance of class A software shall have a non-expired Capability Maturity Model Integrated? for Development (CMMI-DEV) rating, as measured by a Software Engineering Institute (SEI) authorized or certified lead appraiser, of CMMI DEV maturity level 3 Rating or higher for software, or CMMI-DEV Capability level 3 rating or higher in all CMMI-DEV Maturity Level 2 and 3 process areas for software.
For class B software
The contractor responsible for the acquisition, development or maintenance of class B software shall have a non-expired Capability Maturity Model Integrated? for Development (CMMI-DEV) rating, as measured by a Software Engineering Institute (SEI) authorizedDoes SEI use both "authorize" and "certified" with respect to Lead Appraisers in the new v1.3. If not, make consistent. or certified lead appraiser, of CMMI DEV maturity level 2 Rating or higher for software, or CMMI-DEV Capability level 2 rating or higher for software in the following process areas:

  1. Requirements Management
  2. Configuration Management
  3. Process and Product Quality Assurance
  4. Measurement and Analysis
  5. Project Planning
  6. Project Monitoring and Control
  7. Supplier Agreement Management (if applicable).


For class C software, the projectcenter can minimally choose to implement pass down this requirement in accordance with their ccenter's procedures related to class C as long as they provide some action that determines the contractor's capability to develop software in a meets or exceeds disciplined manner. As many NASA contractors are already at CMMI ML2 or higher, projects may alternatively choose to simply require ML2 in their RFP for Class C software.
If a contractor chooses to subcontract the development of class A, B, or C software, then the subcontractor is required tomust have a CMMI ML2 (for class B), ML3 (for class A), or center-specified (for class C) rating in the Supplier Agreement Management process area and levy the project-related requirements on the subcontractor.

General Example

The Contractor and its subcontractors' organizations associated with software development responsibilities shall be at Software Engineering Institute Software Capability Maturity Model Integration (CMMI) - DEVSE/SW/IPPD Maturity Level 3 III (Staged Representation) or higher prior to the Preliminary Design Review. This requirement does not apply to common unmodified commercial-off-the-shelf software procured for the Projectproject.

Examples for RFP Information Technology Management section

Example 1:

Information Technology (IT) Management

  1. For IT applications, other than mission-specific flight and non-flight software, the Contractor shall use Commercial-off-the-Shelf and existing Government-off-the-Shelf products where cost effective to NASA. All IT applications, other than mission-specific flight and non-mission flight software shall comply with NASA requirements as outlined in NPR 7150.2A, NASA Software Engineering Requirements for the appropriate software classes, limited to classes E, F, and G, and as applicable for the project, MPR 2800.4, and NPR 2830.1 NASA Enterprise Architecture Procedures.


Example 2:

Information Technology Management

  1. For IT applications, other than mission-specific software, the Contractor shall:
  • Where cost effective to NASA, use Commercial-Off-The-Shelf (COTS) and existing Government Off-The-Shelf (GOTS) products.
  • Ensure compatibility with existing NASA applications and systems.
  • Comply with NASA requirements for NPR 7150.2A, NASA Software Engineering Requirements for the appropriate software classes, limited to classes E, F, and G, and as applicable for the project.

Examples for RFP Software section


Example 1:

Embedded Software (Firmware)

The Contractor shall develop and maintain software in accordance with NPR 7150.2A, NASA Software Engineering Requirements for the appropriate software classes and as applicable for the project; NASA-STD-8739.8, and NASA Software Assurance Standard (chapters 6 and 7)

Example 2:

Software Engineering

    1. The Contractor shall define, design, develop, test, qualify, integrate, verify, validate, deliver, and maintain all software. The plans for accomplishing this work shall be documented in DRD, Software Development Plan.
    2. The Contractor shall justify the reuse of existing software, modification of existing software, and the development of new software in DRD, Software Development Plan.
    3. The Contractor shall, under Project direction, participate in coordinating with the NASA IV&V Facility in accordance with NASA-STD-8739.8, NASA Software Assurance (Chapter 6 and 7) to plan for the participation of the NASA IV&V Facility in the software development lifecycle activities.
    4. The Contractor and its subcontractors' organizations associated with software development responsibilities shall be at Software Engineering Institute Software Capability Maturity Model Integration (CMMI) – DEV SE/SW/IPPD Maturity Level 3III (Staged Representation) or higher prior to the Preliminary Design Review. This requirement does not apply to commercial-off-the-shelf software procured for the Project.
    5. The Contractor shall develop, update, and maintain all software and software development tools under configuration management in accordance with the DRD, Software Configuration Management Plan.
    6. The Contractor shall develop and maintain electronic Software Development Folders for all flight, ground, and test software per DRD, Software Development Folder.
    7. The Contractor shall use the following guidance document(s) for the development of all software document deliverables:
  • Project Classification Matrix (use as guidance in interpreting flight software classification definitions in NPR 7150.2A)
    1. The Contractor shall use the following standards for designing, developing, and testing all software:
  • NPR 7150.2A NASA Software Engineering Requirements
  • NASA-STD-8739.8, NASA Software Assurance Standard (chapters 6 and 7)


Example 3:
The contractor shall define, design, code, test, integrate, and qualify the software. The contractor shall treat the software component of firmware, which consists of computer programs and data loaded into a class of memory that cannot be dynamically modified by the computer during processing, as software for the purposes of this statement of work. The scope of this activity applies to the re-use of existing software, modification of existing software, and/or development of new software. The contractor shall provide information and access to products under development to provide the government with insight into software development and test activities, including monitoring integration and verification adequacy, auditing the software development process and participation in all software and system reviews. The contractor shall support the implementation of the overall risk management process as well as program status and progress reviews for the software development process. The contractor shall support software Technical Interchange Meetings and other status meetings, as required, to facilitate government insight into the software development. The government insight may include government civil servant insight, government support contractor insight and independent verification and validation review. The contractor shall perform Peer Reviews on Software Requirements Specifications, Software Test Plans, and on selected design and code items and provide results to the government via Software Inspection/Peer Review Reports. The contractor shall maintain software metrics and provide Software Metrics Reports in accordance with DRD.
The contractor shall provide the government web-based electronic access (with access control) to intermediate and final software products (including code) and software process tracking information including software development and management metrics.
The software development shall comply with NPR 7150.2A NASA Software Engineering Requirements as applicable for the project.

Examples for RFP EGSE Software section

Example 1:

EGSE Software

  1. The Contractor shall perform the design, code, Verification, Validation, and delivery of all EGSE code and executables in response to EGSE Subsystem Requirements Document."
  2. The Contractor shall develop and maintain software in accordance with NPR 7150.2A, NASA Software Engineering Requirements for the appropriate software classes and as applicable for the project; and NASA-STD-8739.8, NASA Software Assurance Standard (chapters 6 and 7).


Recommended Technical Review Activities List

Areas to consider for Software Engineering technical review consist of the following:

      • Performing independent assessment of software systems engineering, software processes, software products, software integration, and software test analyses
      • Reviewing all mission critical software products
      • Software schedule and resource assessments and analyses
      • Development of software technical oversight plans
      • Coordination of any software related issues with the project
      • Participate in reviews and Technical Interchange Meetings
      • Perform periodic audits on pre-defined process(es)
      • Chair board or serve as board member, or Review Item Disposition (RID) writer, at a formal review
      • Participate in resolution and closure of issues
      • Independent models to check and compare vendor data
      • Perform evaluations of software products (software documentation, code, etc.)
      • Serve as Software Technical Authority responsible for acquired software products
      • Planning and Project Support:
          • Support and coordinate software trade studies
          • Assess software development processes
          • Support review of system level requirements specifications
          • Support development and review of system level verification and validation test plans
          • Verify compliance with Software Development Plan(s)
          • Verify compliance with software quality and configuration management plans
          • Participate in project documentation reviews
          • Support risk management activities
          • Participate in project and software developer Review Boards, Technical Interchange Meetings, Working Groups and telecons
          • Participate in developer's daily and/or weekly software development activities to maintain knowledge of software development progress
          • Identify and track software metrics
          • Review and assess schedule of the software development activities
          • Provide a status of the developer's software progress, metrics and any problems to the project
          • Conduct periodic site visits as needed to attain knowledge of software development progress
          • Review and assess the content and completeness of instrumentation and command control list (engineering integration database)
      • Requirements analysis:
          • Verify absence of problems and risk items associated with requirements:
      • Documentation standards used and properly applied
      • System requirements clearly organized
      • Even emphasis and levels of detail
      • Consistent identification schemes
      • Clear or concise requirement statements
      • Good sentence structure
          • Good word selection, unambiguous terms
          • Track growth in size and complexity of requirements to identify positive/negative trends
          • Estimate variances in schedule and costs based on requirements size & completeness
          • Support software requirements problem and issue resolution
          • Review and assess the interface specifications and data
          • Verify software requirements traceability
          • Support software requirements walkthroughs
          • Support evaluation of potential requirements changes and associated impacts through the life of the project
      • Design Phase:
          • Support review of preliminary and detailed design specifications (DDS)
          • Support software design problem and issue resolution
          • Verify traceability of design to software requirements
          • Support design walkthroughs
      • Code analysis:
          • Track growth and complexity of source code modules across builds
          • Rank source code modules according to their relative risk, as determined by:
      • Percent of internal documentation
      • Overly large files or modules
      • Use of unstructured programming constructs
      • High decision or calling complexity
      • Unused or "dead" code
          • Poor implementation, if applicable
          • Compliance with program coding standards
          • Develop and maintain knowledge of code functionality
          • Present code functionality to subsystems for validity
          • Support code development and integration testing
          • Support software code problem and issue resolution
          • Support developer code walkthroughs
      • Test Phase:
          • Support development and review of test plans, test procedures and test cases
          • Support TRR:
      • Review and identify discrepancies in software documentation
      • Support final closure of discrepancies
          • Support software test problem and issue resolution
          • Support CSCI integration and test activities
          • Review software test reports
      • Software problem report & effort data analyses:
          • Analyze Problem Reports and present understandable graphical summaries
          • Track error detection and correction rates
          • Assess adequacy of test program
          • Detect schedule risks early
          • Predict effective completion date
      • Software Metrics:
          • Help project office identify applicable software metrics
          • Review and assess the software metric data provided by the contractor
          • Develop, maintain and report software insight metric data to the project
      • Software Independent Verification and Validation (IV&V) support:
          • Perform software criticality assessments,
          • Perform software risk assessments,
          • Develop software IV&V project plans,
          • Develop software IV&V statements of work,
          • Support projects in review of all software IV&V products,
          • Provide expertise and assistance to the projects in resolution and implementation of any software IV&V recommendations.


Statement of Work Checklist

Langley Research Center Statement of Work (SOW) Review ProcedureLee,
Here is the link for the Rev A document on the Agency PAL (part of the NASA Engineering Network (NEN)):
https://nen.nasa.gov/web/software/nasa-software-process-asset-library-pal?p_p_id=webconnector_WAR_webconnector_INSTANCE_PA7b&p_p_lifecycle=1&p_p_state=normal&p_p_mode=view&p_p_col_id=column-2&p_p_col_count=1&_webconnector_WAR_webconnector_INSTANCE_PA7b_edu.wisc.my.webproxy.URL=https%3A%2F%2Fnx.arc.nasa.gov%2Fnx%2Fdsweb%2FGet%2FDocument-499443%2F5523_7-24-06_SOW_RevA_generic-R1V0.doc
There is a Rev B document which I have a copy of as provided by Pat Schuler at Langley. The Rev B document should be the one we used, but should probably go through the "get document from Center PAL to NASA PAL" process., LMS-CP-5523 Rev. B, contains a statement of work checklist as well as practices recognized by OCE as practices that work very well for NASA. See the NASA Agency PAL for the latest version of this checklist.

Example Templates

The following NASA Data Item Descriptions (DIDs) are listed as sample templates for the documentation templates called for during the solicitation portion of the software acquisition process. Center Process Asset Libraries (PALs) should be consulted for DIDs and Data Requirements Documents (DRDs) relevant to a specific NASA center.

9.4.1 Software Documentation Requirements

The NASA software engineering documentation requirements are provided in NPR 7150.2A, Chapter 5 and their applicability to specific classes is described in Appendix D. Included are descriptions for:
Software Development or Management Plan
Software Configuration Management Plan
Software Test Plan
Software Maintenance Plan
Software Assurance Plan
Software Requirements Specification
Software Data Dictionary
Software Design Description
Interface Design Description
Software Change Request/Problem Report
Software Test Procedures
Software User Manual
Software Version Description
Software Metrics Report
Software Test Report
Software Peer Review/Inspection Report

9.4.2 Center DIDs and DRDs

The following DIDs and DRDs are samples available from center PALs. Consult your own center PAL for templates relevant to work performed for your center.

Marshall Space Flight Center Templates
Available from http://spi.msfc.nasa.gov/templates.htmllink and the individual Project Asset sections of the Marshall Space Flight Center PAL.

  • Software Configuration Management Plan
  • Software Test Report (STR) Template
  • Unit Test Procedure Template

Goddard Space Flight Center Templates
Available from http://software.gsfc.nasa.gov/ispaindx.cfm.link

  • Software Management Plan/Product Plan (SMP/PP) for Class A, B, & C Software
  • ISD Software Management Plan/Product Plan (SMP/PP) for Class D&E Software
  • Version Description Document
  • Template for the Software Quality Assurance Plan
  • Configuration Management Plan Template
  • Other templates in progress or not available publicly

10 References

  1. Software Acquisition Statement of Work Guideline, SEPG-SWACQ-PRC-1, Glenn Research Center. Link to: https://nen.nasa.gov/web/software/nasa-software-process-asset-library-pal?p_p_id=webconnector_WAR_webconnector_INSTANCE_PA7b&p_p_lifecycle=1&p_p_state=normal&p_p_mode=view&p_p_col_id=column-2&p_p_col_count=1&_webconnector_WAR_webconnector_INSTANCE_PA7b_edu.wisc.my.webproxy.URL=https%3A%2F%2Fnx.arc.nasa.gov%2Fnx%2Fdsweb%2FGet%2FDocument-499288%2FSoftware%2BAcquisition%2BSOW%2BGuideline.doc
  1. Prepare Presolicitation Documents, LMS-OP-4509, Langley Research CenterLink to doc (needs to be moved to Agency PAL).
  2. Statement of Work (SOW) Review Procedure, LMS-CP-5523, Langley Research Center.Lee,
    Insert link to doc (needs to be moved to Agency PAL)...see note and link in section 9.1 above
  1. Product Requirements Development and Management Procedure, LMS-CP-5526, Langley Research Center.Link to doc (needs to be moved to Agency PAL)
  1. Process for Conducting a Make/Buy Analysis, 580-SP-075-01, Goddard Space Flight Center. Link to http://software.gsfc.nasa.gov/AssetsApproved/PA2.1.1.1.doc
  2. WBS Checklist Tool, Goddard Space Flight Center. Link to: http://software.gsfc.nasa.gov/toolsDetail.cfm?selTool=1.2.4.0
  3. Software Supplier Agreement Management Plan, Jet Propulsion Laboratory. Link to: https://nen.nasa.gov/web/software/nasa-software-process-asset-library-pal?p_p_id=webconnector_WAR_webconnector_INSTANCE_PA7b&p_p_lifecycle=1&p_p_state=normal&p_p_mode=view&p_p_col_id=column-2&p_p_col_count=1&_webconnector_WAR_webconnector_INSTANCE_PA7b_edu.wisc.my.webproxy.URL=https%3A%2F%2Fnx.arc.nasa.gov%2Fnx%2Fdsweb%2FGet%2FDocument-499361%2FJPL%2BSoftware%2BSupplier%2BAgreement%2BManagement%2BPlan%2B%28SSAMP%29%2BTemplate%2B%2804-15-02%29.doc
  1. Software Assurance: Five Essential Considerations for Acquisition Officials, Mary Linda Polydys, Stan Wisseman, STSC Crosstalk, July 2005
  2. A Method for Reasoning About an Acquisition Strategy, Mary Catherine Ward, Joseph P. Elm, Software Engineering Institute (SEI), 2005
  3. Software Acquisition Best Practices: 2004 Edition, Adams, Eslinger, Owens, Rich, 3rd OSD Conference on the Acquisition of Software-Intensive Systems8, 9, 10 - Link to docs once location is determined.
  • No labels