WEIS Market Trials Overview for Southwest Power Pool

WEIS MARKET TRIALS Helping our members work together to keep the lights on... today and in the future. SPPorg southwest-power-pool SouthwestPowerPool

MARKET TRIALS STRUCTURED/ UNSTRUCTURED TEST KICKOFF JULY 20, 2020 2 Helping our members work together to keep the lights on... today and in the future. SPPorg southwest-power-pool SouthwestPowerPool

AGENDA Market Trials Overview WRTBM Base Case Overview Operation Test Scenario Overview Deployment Test Overview Recap of Key Points and Next Steps Questions 3

WEIS MARKET TRIALS OVERVIEW CHRIS BALDWIN 4

MARKET TRIALS CALENDAR Date July 20, 2020 January 18, 2021 August 3, 2020 November 20, 2020 August 17, 2020 November 20, 2020 (Mon., Tue., Fri.) Party SPP MPs SPP MPs SPP MPs BAs West RC Action Weekly WEIS Market Trials test communication calls Tues & Thurs each week: Structured Testing in MTE Wed & Fri each week: Unstructured Testing in MTE Deployment Testing in MTE August 17, 2020 SPP MPs/MAs The first operating day for SPP to settle. First day for Meter Agents to start submitting Meter Data The first day SPP will be posting settlements statements (OD Aug 17) MPs set up APIs and listeners in Production, LSAs set up users with certificates and roles in Production PRD Connectivity Testing and Verification August 24, 2020 SPP November 23, 2020 December 9, 2020 November 23, 2020 December 9, 2020 December 10, 2020 January 14, 2021 February 1, 2021 MPs SPP MPs SPP MPs SPP MPs Parallel Operations testing in Production WEIS Market Go-Live 5

COMMUNICATION PLAN Submit all inquiries through the SPP Request Management System (RMS) using the WEIS Market Quick Pick and Subtype 1 of Market Trials. For errors or unexpected results that occur during test execution, which require SPP troubleshooting or intervention, MPs should provide error steps and details through RMS using the WEIS Market Quick Pick and Subtype 1 of Market Trials. For mass or immediate communications that need to be sent from SPP to Market Participants, outreach will be via e-mail to WEIS Market Testing Liaisons. All other SPP communications to specific Market Participants will be sent to WEIS Market Testing Liaisons via RMS. SPP will publish Market Trials materials to the WEIS Market Trials folderon SPP.org. 6

REQUEST MANAGEMENT SYSTEM (RMS) Submit all inquiries through the SPP Request Management System (RMS) using the WEIS Market Quick Pick and Subtype 1 of Market Trials. RMS tickets should be user for: Submission of all testing questions and issues Return of completed test scripts and sign-off documentation 7

WEEKLY TESTING MEETINGS WEIS Market Trials Test Communication Calls will occur every Monday morning from July 20, 2020, through January 18, 2021. Attendance to these calls should include WEIS Market Testing Liaisons or their proxy. The intent of these meetings is to review testing results of the week and inform Market Participants of upcoming action items. The meetings serve as an open forum for Market Participants to follow up on any open questions. Some weeks, SPP will use the meeting as a kickoff for an upcoming Market Trial test stage or a Go No/Go meeting. SPP will publish agendas for each meeting in advance. 8

MARKET TRIALS CALENDAR SPP will produce a calendar for WEIS Market Trials. The calendar will be a living document and updated periodically during testing. SPP staff will discuss updates to the calendar in the weekly testing meeting. In addition to identifying important dates during WEIS Market Trials, the calendar will track market trials milestones. Events listed on the calendar will include: Daily submission data Operational test scenarios Deployment tests MP testing-status conference calls Go/no-go checkpoints for Market Trials SPP company holidays The document can be found in the Market Trials Folder on spp.org here. 9

SETTLEMENTS CALENDAR SPP will post a settlements calendar to the MTE portal that reflects the accelerated schedule to be used in MTE. S7 posts OD+7, S53 posts OD+21, S120 posts OD+35. The normal settlement schedule will apply during Parallel Operations. S7 posts OD+7, S53 posts OD+53, S120 posts OD+120, so we will only be producing S7s during Parallel Operations. The WEIS Market Trials Settlement Calendar is available on the Portal in both Excel and PDF formats here: https://marketplace- mte.itespp.org/pages/settlement-calendars. SPP staff will communicate any updates to the calendar in the Weekly Testing Meetings. 10

WRTBM BASE CASE CHRIS BALDWIN 11

WRTBM BASE CASE SPP will host an unstructured test period beginning on Monday, August 3, 2020 and continuing through Friday, November 20, 2020. Unstructured testing is provided for the purposes of testing typical market functionality. The WEIS Market Trials WRTBM Base Case Scenario Guide, and the associated test checklists, are provided for the purposes of testing Market and Settlement UI/API functionality. Though unstructured testing can be performed at any time, SPP has scheduled time for completion of unstructured testing to occur every Monday, Wednesday and Friday of each week during this test period. Additional structured test scenarios are scheduled to occur on Tuesday and Thursday each week of this test period. These structured test scenarios, described separately, are provided for the purpose of testing specific functionality or to create specific results in order to ensure that the WEIS market functions as intended. Deployment testing will be scheduled with each MP to occur on an unstructured test day (Monday, Wednesday, or Friday). More information about Deployment Testing will be provided separately. 12

WRTBM BASE CASE DETAIL Beginning August 3, 2020 and continuing through November 20, 2020, SPP plans to execute the WRTBM persistently for each operating day (except during communicated maintenance windows) to generate and communicate dispatch instructions and locational marginal prices (LMP). Except for resources participating in an active deployment test, these setpoints are informational only, and MPs should not follow them at this time. WRTBM notifications will be consistent with SPP WEIS Market protocols. During this period, MPs will be expected to test market functionality such as submitting resource offers, validating WRTBM results and confirming receipt of market notifications and messages. 13

SETTLEMENTS BASE CASE DETAIL From August 17, 2020, through Nov. 20, 2020, SPP plans to settle each operating day using an accelerated posting schedule: S7 (OD+7), S53 (OD+21), S120 (OD+35), R (# of Days after OD), etc. SPP will post a settlements calendar that reflects the accelerated schedule here: https://marketplace- mte.itespp.org/pages/settlement-calendars-weis. SPP will post settlement results for each operating day to allow MPs to process and download statements and invoices. SPP expects MPs to ensure the MA is submitting meter data on a daily basis. 14

ASSUMPTIONS & RECOMMENDATIONS Testing will occur in SPPs Member Testing Environment (MTE) which is located here: https://marketplace-mte.itespp.org/. WRTBM setpoints are for informational and testing purposes only. Resources are not expected to follow these setpoints except during a scheduled Resource Deployment test. WRTBM LMPs are provided for informational and testing purposes only. Resource Offers and real-time ICCP from Non-Dispatchable Variable Energy Resources (NDVER) and Partial Participation Resources (PPR) are expected to be provided for participation in this scenario. Review Section 4.2.3.4 of the Market Protocols to understand the exceptions related to these resource types. MPs should strive to provide realistic resource offers, status and availability information in accordance with the WEIS Market Protocols. MPs are expected to create tags (schedules) using valid source and sinks. MPs, and their respective MAs, should strive to submit realistic meter data on a regular basis and review meter reports to gain familiarity with the meter data process. MPs should access their settlement results on a regular basis to understand the financial impacts of the WEIS Market. 15

MP MARKET ACTIVITIES MPs are expected to perform the following steps for the duration of the WRTBM base case scenario scheduled for August 3 November 30, 2020. Verify that non-conforming load forecasts are submitted and updated, as necessary Verify that the tags (schedules) entered are representative of the physical paths currently used in production. Verify that reasonable resource offers are submitted and updated as necessary, including resource and ancillary service plans using the resource commitment status. Update a unit s min/max capacity if it changes by >10% or 5 MW, whichever is greater Update a unit s offer curve if it changes by >10% or $2 per 5 MWs, whichever is greater 16

MP MARKET ACTIVITIES CONT Verify that the Automatic Generation Control (AGC) System Control Status is available via ICCP. Verify that results of the WRTBM are received and meet expectations. Verify that market messages and notifications are received and meet expectations. Verify that market UI/API transaction records are available and meet expectations. Verify that market data is available and meet expectations. Notify SPP to report and receive support for any unexpected issues. Complete and submit scenario test checklist via RMS. 17

ENERGY SCHEDULES For Market Trials in MTE, MPs should replicate and tag all physical paths currently used for production. Tagging in MTE will give MPs the opportunity to see how the mapping works and be able to follow a tag through to the settlement statement. 18

TAGGING IN MTE (OATI) MPs will use one of the following two options to submit tags for use in Market Trials testing in MTE. MP tagging will be supported by OATI as described below. MPs that use OATI as their tagging vendor should use the following URL for submitting tags: https://demo1.spp.tag.oati.com. OATI Tagging Customers can request User Interface System access by contacting OATI Support (oati.support@oati.net) and Ben Stander (Ben.Stander@oati.net), with the subject OATI GUI access to demo1.spp.oati.com. 19

TAGGING IN MTE (NON-OATI) MPs that use a non-OATI tagging vendor will use the following URL and information for the alternative XML messaging site: https://demo1.spp.tag.oati.com/oati/tagging.wml. This URL will be available for MP-directed testing on Monday, July 13, 2020. SPP will not test this functionality. MPs will be required to ensure this functionality is available and working correctly prior to the start of Structured and Unstructured testing on August 3, 2020. (Optional) If PSEs want to view/approve tags in their vendor system, they will need to provide agent and approval URLs for their vendor s test system to OATI. This information is not needed by July 13 and can be provided closer to actual testing. For any questions related to access and configuration of non-OATI XML tag submission, please contact OATI Support (oati.support@oati.net) and Ben Stander (Ben.Stander@oati.net). 20

MP SETTLEMENT ACTIVITIES MPs are expected to perform the following post operating day settlement activities in MTE during the bid-to-bill portion of market trails which is scheduled for operating dates August 17, 2020 through November 20, 2020. For complete details on all post operating day settlement activities, reference Section 4.5 of the WEIS Market Protocols. All meter submission due dates and settlement results posting dates can be found on the posted MTE settlement calendar: https://marketplace- mte.itespp.org/pages/settlement-calendars-weis. 21

MP SETTLEMENT ACTIVITIES CONT Verify that meter data is submitted by the MA on a daily basis and is updated as needed for each operating day and settlement type according to the posted settlement calendar. Verify that settlement results for a given posting day are accessible and available for download according to the posted settlement calendar. Validate the accuracy of settlement results and perform shadow settlement calculations if applicable. This includes verification of schedule data and the financial implications of the data on the Energy Imbalance Service (EIS) charge type. Verify the settlement invoices are accessible and available for download on a weekly basis per the posted settlement calendar. 22

MP SETTLEMENT ACTIVITIES CONT Validate the accuracy of the settlement invoices based on the posted settlement results. Verify appropriate users have access to submit WEIS Market settlement disputes on behalf of the MP. Register for applicable settlement notifications and verify they are received as expected. Notify SPP of any unexpected issues in a timely manner via RMS. Complete and submit a set of successfully completed settlement test cases via RMS; test cases can be completed at any point during Market Trails. Review settlement scenario scorecards weekly to monitor the MPs progress on the settlement scenarios. Any missed scenarios or requests for additional scenarios can be submitted via RMS and SPP will try to accommodate these as time allows. 23

STRUCTURED/UNSTRUCTURED TEST EXIT CRITERIA All Market Participants are required to participate SPP will measure participation based on execution in the market. The following measurement criteria will be used to determine MP participation in Market Trials: MPs representing Resources: Resource-Owning MPs need to submit and maintain RTBM offers for each operating day Meter Agents: Submit meter data on a daily basis starting August 17th MPs representing BAs will verify that they are receiving EI offsets and results of the Supply Adequacy analysis All other MPs will verify that they are receiving their Supply Adequacy results MP s must complete and return the WRTBM Markets and Settlements Test Checklists SPP will request an attestation statement from each MP to move to the next stage of Market Trials 24

WEIS WRTBM BASE CASE GUIDE The purpose of the WEIS WRTBM Base Case document is to guide Market Participants (MPs) of the Western Energy Imbalance Services (WEIS) Market through testing of the Western Real- Time Balancing Market (WRTBM) base case scenario which includes typical market and settlement functionality. This document also describes SPP and MP roles and responsibilities necessary to complete this test scenario. The document can be found in the Market Trials Folder on spp.org here. 25

WEIS WRTBM TEST CHECKLISTS MPs will use the WRTBM Base Case guide and the associated scenario test checklist to track and submit their progress through RMS. WEIS WRTBM Markets Test Cases WEIS WRTBM Settlements Test Cases The checklists can be found in the Market Trials Folder on spp.org here. 26

WEIS WRTBM MARKET TEST CASES 27

WRTBM SETTLEMENT TEST CASES 28

STRUCTURED/UNSTRUCTURED TEST COMPLETION ATTESTATION STATEMENT The checklists can be found in the Market Trials Folder on spp.org here. 29

OPERATIONAL TEST SCENARIOS CHRIS BALDWIN 30

OPERATIONAL TEST SCENARIOS SPP will initiate various scenarios to simulate operational events on structured days (Tuesdays and Thursdays) beginning in September and continuing until the end of Structured and Unstructured period, November 20, 2020. 31

OPERATIONAL TEST SCENARIOS CONT The checklists can be found in the Market Trials Folder on spp.org here. 32

DEPLOYMENT TESTS CHRIS BALDWIN 33

DEPLOYMENT TESTS SPP will schedule a series of deployment tests to demonstrate that MPs can follow Setpoints sent by SPP through ICCP. During every deployment test, SPP will open a call to include the participating BA, MP, SPP WEIS Market Operator, SPP West RC, and SPP testing staff. These open calls will allow for immediate communication of any issues experienced during the test and, if needed, early termination of the deployment test by any party on the call. Prior to August 12, 2020, each MP Liaison will provide by RMS a list of resources participating in deployment testing. The following guidelines must be used when selecting your resources: Resource must be dispatchable and able to respond to ICCP set points. Do not include Partial Participating Resources, NDVERs, or critical resources such as nuclear-fueled power plants Resource must have a registered maximum of at least 10MW Provide at least one resource per registered resource type (DVER, GEN, PLT) 34

DEPLOYMENT ENTRY/EXIT CRITERIA MARKET PARTICIPANT ENTRY CRITERIA Market participants involved in Market Trials testing have completed all training modules Must have ICCP objects available for consumption by the market systems MARKET PARTICIPANT EXIT CRITERIA All market participants have successfully participated in: At least 2 successful deployment tests overall At least 1 successful deployment test for each type of resource (DVER, GEN, PLT), excluding exempt resources SPP will request an attestation statement from each MP to move to the next stage of Market Trials. 35

DEPLOYMENT TESTING PLAN Testing is for Resources that would be dispatchable in the WEIS Market. PPRs, NDVERs, Nuclear Resources, and resources registered with less than 10 MW will not be tested in the WEIS Deployment Test. Resources will be organized into groups based on similar ramp rates, market participant, and availability. SPP will schedule multiple deployment tests, each with a duration between 1 hour and 2 hours, depending on resource availability. SPP will use a deployment test plan that is intended to reduce the overall impact to the participating balancing authorities. As one Resource is moved up, another Resource will be moved down. Deployment Plans will be created for testing and shared with MPs and the participating BA. 36

DEPLOYMENT TESTING PLAN CONT During these tests the participating BAs will continue to perform BA functions. Tests should not interfere with BA responsibilities. SPP, the participating Balancing Authority or Reliability Coordinator may terminate the deployment test at any time. If approved by SPP, a terminated test may be restarted the same day if all market participants for that group agree. In coordination with market participants, SPP may modify the Deployment Tests Schedule as needed. 37

SETUP ASSUMPTIONS Since deployment testing will be scheduled during Market Trials testing in MTE, it is expected that MPs are already submitting reasonable and valid Resource plans and offers. Market participants should submit the following Resource offers for Resources participating in WEIS Deployment Tests: Commit Status Self Realistic operating limits and ramp rates Realistic Energy Offer Curve WEIS Market Participants participating in each test are expected to follow the SPP setpoint instructions delivered by ICCP. No financially-binding Market Settlement calculation will be performed 38

MARKET PARTICIPANT ACTIVITIES Telemeter the appropriate ICCP control status Telemeter the current resource output for the participating resources Coordinate with SPP any necessary updates to resource offers after the offer period has closed Monitor SPP setpoints and dispatch participating resources accordingly 39

WRAPPING IT UP CHRIS BALDWIN 40

KEY POINTS Testing Period: August 3 November 20 Submit All Questions via RMS Return the following documents as soon as completed via RMS. Due no later than November 20: WEIS WRTBM Market Test Cases WEIS WRTBM Settlement Test Cases Structured/Unstructured Test Completion Attestation Statement Deployment Test Completion Attestation Statement PROD Connectivity Testing begins November 23 Next Steps 41

42