Trials and Tests Overview for Maintaining Power Grid Stability

WEIS MARKET TRIALS Helping our members work together to keep the lights on... today and in the future. SPPorg southwest-power-pool SouthwestPowerPool

MARKET TRIALS CONNECTIVITY TEST KICKOFF JUNE 3, 2020 2 Helping our members work together to keep the lights on... today and in the future. SPPorg southwest-power-pool SouthwestPowerPool

AGENDA Market Trials Overview Connectivity Test Portal and LSA Tests Market Tests Settlements Overview Tagging Overview Recap of Key Points and Next Steps Questions 3

WEIS MARKET TRIALS OVERVIEW CHRIS BALDWIN 4

MARKET TRIALS CALENDAR Date June 3, 2020 Party SPP MPs MPs Action MP Testing Kick-Off Call and walk through of system changes MPs set up APIs and listeners in MTE, LSAs set up users with certificates and roles in MTE Connectivity Testing in MTE June 1, 2020 June 30, 2020 July 1, 2020 July 31, 2020 July 20, 2020 January 18, 2021 August 3, 2020 November 20, 2020 August 3, 2020 November 20, 2020 (Mon., Tue., Fri.) SPP MPs SPP MPs SPP MPs SPP MPs BAs West RC MPs Weekly WEIS Market Trials test communication calls Tues & Thurs each week: Structured Testing in MTE Wed & Fri each week: Unstructured Testing in MTE Deployment Testing in MTE November 23, 2020 December 9, 2020 November 23, 2020 December 9, 2020 December 10, 2020 January 14, 2021 February 1, 2021 MPs set up APIs and listeners in Production, LSAs set up users with certificates and roles in Production PRD Connectivity Testing and Verification SPP MPs SPP MPs SPP MPs Parallel Operations testing in Production WEIS Market Go-Live 5

MARKET TRIALS TEST STAGES Connectivity Test in MTE Structured/Unstructured Testing Deployment Testing Connectivity Test in Prod Parallel Operations in Prod 6

MTE CONNECTIVITY TEST Environment: MTE Dates: 7/1/2020 7/31/2020 This stage ensures stakeholders can connect to and exchange information with all necessary SPP systems required for participating in subsequent stages of Market Trials. Successful completion of this stage is required to advance to the next stage of Market Trials. 7

STRUCTURED/UNSTRUCTURED TEST Environment: MTE Dates: 8/3/2020 11/20/2020 During this stage, MPs and SPP staff will perform several structured test scenarios that are intended for SPP and stakeholders to simulate specific actions expected to occur in the WEIS Market. These scenarios will encompass both operational and settlement scenarios described separately in supplemental documentation. MTE will also be available for unstructured, i.e. sandbox, testing anytime a structured test scenario is not scheduled to occur. 8

DEPLOYMENT TESTING Environment: MTE Dates: 8/17/2020 11/20/2020 During this stage, SPP will issue Real-time deployment instructions to dispatchable Resources to confirm their ability to successfully follow ICCP Setpoints. Not all resources are required to participate in Deployment Tests. There will be exceptions for non-dispatchable resources, such as a Non- Dispatchable Variable Energy Resource (NDVER), Partial Participating Resource (PPR) or critical resources such as nuclear-fueled resources. 9

PROD CONNECTIVITY TEST Environment: PROD Dates: 11/23/2020 12/9/2020 West Market Participants test their PRD OATI certificates if not already done in earlier Connectivity Testing stage Access to the PRD SPP Portal Receiving a test PRD Notification from SPP s PRD environment Insure that PRD roles are set up 10

PARALLEL OPERATIONS Environment: PROD Dates: 12/10/2020 1/14/2021 This stage is the final period of testing to simulate day-in-the-life operation of the WEIS Market. There will be no expectation for dispatchable resources to follow Setpoints. 11

COMMUNICATION PLAN Submit all inquiries through the SPP Request Management System (RMS) using the Project Inquiries Quick Pick and Subtype 1 of WEIS Market Trials. For errors or unexpected results that occur during test execution, which require SPP troubleshooting or intervention, MPs should provide error steps and details through RMS using the Project Inquiries Quick Pick and Subtype 1 of WEIS Market Trials. For mass or immediate communications that need to be sent from SPP to Market Participants, outreach will be via e-mail to WEIS Market Testing Liaisons. All other SPP communications to specific Market Participants will be sent to WEIS Market Testing Liaisons via RMS. SPP will publish Market Trials materials to the WEIS Market Trials folderon SPP.org. 12

WEEKLY TESTING MEETINGS WEIS Market Trials Test Communication Calls will occur every Monday morning from July 20, 2020, through January 18, 2021. Attendance to these calls should include WEIS Market Testing Liaisons or their proxy. The intent of these meetings is to review testing results of the week and inform Market Participants of upcoming action items. The meetings serve as an open forum for Market Participants to follow up on any open questions. Some weeks, SPP will use the meeting as a kickoff for an upcoming Market Trial test stage or a Go No/Go meeting. SPP will publish agendas for each meeting in advance. 13

WEIS CONNECTIVITY TESTING CHRIS BALDWIN 14

PURPOSE To ensure new Market Participants can do the following: - Access the Integrated Marketplace Portal - Access and submit to the Markets User Interface - Access and submit to the Settlements User Interface - Access and submit tags - Subscribe to Settlements Notifications 15

PURPOSE (CONTINUED) Please understand that SPP will provide you with all documents, access and preparation time to set up your companies strategy and systems for their production date. SPP is not allowed to assist a Market Participant with their market strategy per the SPP Protocols. The purpose of this exercise is to access the systems and information needed to participate in the WEIS Market. The Member Test Environment (MTE) is populated with the appropriate amount of generic data provided for connectivity testing. 16

IMPORTANT DATES Connectivity Testing Dates: July 1 - 31 Test Checklist / Sign-Off Attestation due by: July 31 Structured / Unstructured Testing: August 3 17

REQUEST MANAGEMENT SYSTEM (RMS) Submit all inquiries through the SPP Request Management System (RMS) using the Project Inquiries Quick Pick and Subtype 1 of WEIS Market Trials. RMS tickets should be user for: Submission of all testing questions and issues Return of completed test scripts and sign-off documentation 18

TEST CHECKLISTS The Test Checklist was designed to assist users in determining their applicable test cases to be completed during New MP Testing. Applicability is based on Customer type, MP type, and implementation of APIs and Notifications. The user will complete the applicable tests and use this document to track their results as 'pass / fail / not applicable'. For failed test cases the tester should submit a RMS ticket to alert the SPP staff so they can start to troubleshoot the issue. Once completed, this document should be submitted to SPP in order to confirm and track completion. 19

TEST CHECKLISTS (CONTINUED) The MTE Test Checklist consists of multiple tabs for different areas of testing. The potential areas of testing consist of: Portal, Markets, Settlements, Tags and XML Notification Listener. Each tab consists of both UI and API test cases. MPs not using APIs can skip these tests. It is strongly recommended that users who plan to access the SPP systems via API only, also test UI access as a backup method. 20

CONNECTIVITY TEST COMPLETION ATTESTATION STATEMENT 21

CONNECTIVITY TEST EXIT CRITERIA All Market Participants are required to participate Each MP will have completed the Connectivity Checklist and returned it to SPP indicating success SPP will request an attestation statement from each MP to move to the next stage of Market Trials The status of each MP s readiness to move between each stage of market trials will be reported to the program leadership, including the WMEC. 22

PORTAL & LSA TESTS CHRIS BALDWIN 23

PORTAL & LSA TESTS All MP companies are to test using Two-Factor Authentication to access the Marketplace Portal with a valid certificate in conjunction with a Login ID and Password typed into a login screen. MPs will also test changing a password and initiating a password reset for a forgotten password. Note: MP Marketplace Portal passwords must be changed at least every 90 days. All MPs requiring access will require separate set- up on the Production Marketplace Portal. SPP does not migrate user access to other environments. 24

PORTAL LOGIN Below is the information needed to log into the Marketplace Portal: The Login ID will be the valid, e-mail address associated with the user in the Manage Users screen within the Marketplace Portal. The temporary / initial password for first time users to access the Marketplace Portal is emailed once they are setup in the Marketplace Portal. The temporary password will be used to complete the initial login; users will be required to set a new password for their account. 25

PORTAL REFERENCE MATERIAL To open links right click them and select Open Hyperlink . Portal User Job Aid Aids MPs in logging into the Portal for the first time (Available in LMS) 26

MARKETS CHRIS BALDWIN 27

MARKET USER INTERFACE After logging into the Markets UI, select Filtering and adjust the filter to allow you to see the full 7 days into the future. 28

MARKET REFERENCE MATERIALS To open links right click them and select Open Hyperlink . WEIS Markets WSDLs & XSDs Folder containing the current Markets Web Services Data Exchange Guide for the WEIS Markets SPP WEIS Market User Interface Guide User manual to the Market User Interface System and the interfaces provided by SPP . SPP WEIS Market User Interface Business Validations Provides business validation rules associated with market ops data submittals. * Please be sure to read the Introduction and User Interface sections at the beginning of the User Interface Guide. These will help you in basic use of the application. 29

MTE CONNECTIVITY SPECIFICATIONS SPP Connectivity Specifications Document Provides the Connectivity Specifications including IP addresses, URLS, etc. MPs will use this document to assist in setting up Listeners. MPs will use this document to assist in setting up APIs to meet the Two-Factor Authentication requirements. 30

SPP PROTOCOLS WEIS Market Protocols Provides background information, guidelines, business rules, and processes for the operation and administration of the SPP Integrated Marketplace and the Reliability Unit Commitment processes, including market settlements, billing, and accounting requirements. 31

MARKET SETTLEMENTS MIA WILSON & JENA HARRELL 32

MARKET SETTLEMENT PORTAL The WEIS Settlements User Interface Guide provides step-by-step instructions for submitting meter data, subscribing to notifications, and downloading settlement results, and will be posted prior to the start of structured / unstructured testing. SPP Portal > Settlements > WEIS Market * Users must be granted access by their LSA to see the Settlements menu. 33

MARKET SETTLEMENT REFERENCE MATERIALS To open links right click them and select Open Hyperlink . WEIS Settlement Management System API XML Specifications Technical Guideline and Specifications for APIs, including Meter, Notifications, and Settlement Reports. Includes sample XML files for upload and download. WEIS Settlement User Interface Guide How to submit meter data, subscribe to notifications, and download settlement results via the SPP Portal. WEIS Settlement Member Data Exchange Validations Describes the validations associated with data uploads & downloads via the Settlements UI and API. Note: The WEIS Settlement UI Guide and Data Exchange Validation documents are not yet available, but will posted prior to the start of Structured / Unstructured Testing. 34

MARKET SETTLEMENT REFERENCE MATERIALS (CONT.) Section 4.5 of the WEIS Market Protocols covers all post operating day activities including settlement activities and calculations. Settlement Charge Types (inputs and outputs) are included in the following sections of the Protocols: 4.5.6.1 Energy Imbalance Service Amount 4.5.6.2 Real-Time Out of Merit Amount 4.5.6.3 Uninstructed Resource Deviation Amount 4.5.6.4 Miscellaneous Charge Type 4.5.6.5 Revenue Neutrality Uplift Charge Type Settlement Statement Process is outlined in section 4.5.7 including the settlement types, reports and posting timelines. Settlement Invoice & Dispute Process is outlined in sections 4.5.8, 4.5.9, and 4.5.10. 35

TAGGING OVERVIEW CHRIS BALDWIN 36

TAGGING MPs should request access through the OATI help desk: 763-201-2020 to SPP s demo tagging environment. SPP s demo tagging environment URL is https://demo1.spp.tag.oati.com. MPs need an OATI certificate to gain access. It can be the same certificate they use with the production tagging system today. MPs will create tags for settlements and markets using valid source sinks registered with the market. 37

LSA INFORMATION CHRIS BALDWIN 38

LSA ACKNOWLEDGEMENT As the Local Security Administrator (LSA), I acknowledge my responsibility to provision, request, and approve access consistent with my company s policies and procedures as well as SPP s policies, procedures, and governing documents, including but not limited to the SPP Tariff, Business Practices and Market Protocols. Any access provisioned by an LSA is the sole responsibility of that LSA. 39

LSA REFERENCE MATERIAL The following materials will assist you in completing your tests: Portal Application Role Reference Guide Used to assist Local Security Admin (LSA) in setting up user roles. LSA UAA Job Aid Quick How To Guide on using the LSA screens and tasks associated with maintaining users. These documents can be found on the UAA and will be available to your LSA as soon as you have access. 40

DIGITAL CERTIFICATE LSAs are able to configure access based on use of OATI Digital Certificates. The certificate is needed to access any application within the Marketplace Portal. A digital certificate is an electronic credit card that establishes your credentials when doing business or other transactions on the internet. SPP requires ONE digital certificate per USER issued by OATI to be used for WEIS Market UIs, APIs, and client applications. For XML Notification Listener Servers (required for an Asset Owning MPs), MPs or MAs may use any certificate authority for the server certificate, expect self-signed. The Onboarding Specialist will send the LSA an email with the instructions on how to send the certificate information in the appropriate WEIS Market format. 41

KEY POINTS Testing Period: July 1 - 31 Submit All Questions & Documentation via RMS Test Sign-Off Required by EOB July 31 Structured / Unstructured Testing begins August 3 Next Steps PLEASE NOTE: All initial setup done in MTE will need to be repeated in the Production environment prior to Parallel Operations. 42

43