Enhancing System Downtime Solutions in the Public Sector

Slide Note

The presentation addresses the challenges faced by the SITA NGN core network due to infrastructure issues like vandalism and load shedding. It discusses steps taken to stabilize the network, including the procurement of an alternate provider for redundancy. The focus is on improving network availability and service delivery in the public sector.

Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

uriel Follow

Uploaded on May 13, 2024 | 0 Views

Presentation Transcript

Presentation to: Presentation to: Portfolio Committee on Public Service and Portfolio Committee on Public Service and Administration Administration Organisation: Organisation: SITA SITA Topic Topic : : Interventions to Improve the System Downtime Interventions to Improve the System Downtime and Impact on Service Delivery in the Public and Impact on Service Delivery in the Public Sector Sector Presented By: Presented By: Managing Director Managing Director Dr Bongani Andy Mabaso Dr Bongani Andy Mabaso Date: Date: 20 September 2023 20 September 2023

Problem Statement Problem Statement The Government Core network (also known as the SITA NGN) makes use of Broadband Infraco (BBI) long distance fibre network for the Layer 2 transmission that interconnects SITA Points of Present (POP) sites across all nine provinces. BBI s infrastructure includes elements inherited from Eskom and Transnet Freight Rail. The infrastructure challenges faced by the latter organisations in terms of the destruction on the rail network and loadshedding have been among the biggest causes of network downtime. Persistent downtime experienced on the BBI links have recently resulted in the continued disruption of services. The existing design of the SITA NGN core is characterized with a number of single points of failure, which presents serious limitations in terms of failover. The impact of persistent economic sabotage (vandalism and theft of cables) as well as loadshedding have had a significant impact on the delivery of IT services. This presentation will highlight remediation/steps taken to address the above risks, stabilise, and improve the availability of the SITA Core network. SITA SOC Ltd 2

1. STABILISATION OF THE SITA CORE NETWORK SITA SOC Ltd 3

Topological Depiction of the Existing SITA NGN Core Network Topological Depiction of the Existing SITA NGN Core Network Single Points of Single Points of Failure. Failure. SITA SOC Ltd 4

Stabilisation of the SITA Core Network Stabilisation of the SITA Core Network o In an effort to stabilise the Core network and improve its availability, after having identified the most problematic Core links, and given the urgency of the situation it was decided to utilise a single source procurement approach to appoint an alternate provider to provide additional redundancy. o This single source procurement approach which received the approved of National Treasury resulted in the successful appointment of Liquid Intelligent Technologies (LIT), and the implementation of the identified additional links is underway and is planned to be completed by 30 September 2023. SITA SOC Ltd 5

Example: Depicting Single Points of Failure at Provincial Level Using BBI Links Only Example: Depicting Single Points of Failure at Provincial Level Using BBI Links Only SITA SOC Ltd 6

Example: Elimination of Single Points of Failure at Provincial Level Using both BBI & LIT Links Example: Elimination of Single Points of Failure at Provincial Level Using both BBI & LIT Links Introducing LIT 1 Gbps link between PMB and Centurion. Ulundi also gets 2 X 1 Gbps to provide the needed redundancy. Add additional 2 X 1Gbps links from PMB to Cape town for failover conditions for KZN and for the Eastern Cape. 2 X 1 Gbps links between Cape Town and Centurion accommodate additional traffic as a result of failure conditions. SITA SOC Ltd 7

Stabilisation of SITA Core Network Stabilisation of SITA Core Network Implementation of Alternative Layer 2 Links Implementation of Alternative Layer 2 Links Province Province Description Description Commissioned Commissioned (Yes/No) (Yes/No) Planned Planned Installation date Installation date Comments Comments Eastern Cape Bhisho to Cape Town Yes 09 Sept 2023 Completed Bhisho to Pietermaritzburg Yes 05 Oct 2022 Completed Bhisho to Mthatha Yes 05 Oct 2022 Completed Bhisho to Port Elizabeth Yes 05 Oct 2022 Completed Bhisho to East London Yes 05 Oct 2022 Completed KwaZulu - Natal Pietermaritzburg to Centurion Yes 09 Sep 2022 Completed 2X Pietermaritzburg to Ulundi Yes 12 Sep 2022 Completed Pietermaritzburg to Durban Yes 13 Sep 2022 Completed 2X Pietermaritzburg to Cape Town Yes 16 Sep 2022 Completed SITA SOC Ltd 8

Stabilisation of SITA Core Network Stabilisation of SITA Core Network Implementation of Alternative Layer 2 Links Implementation of Alternative Layer 2 Links Province Province Description Description Commissioned Commissioned (Yes/No) (Yes/No) Completion date Completion date Comments Comments Limpopo 2 x Polokwane to Centurion Yes 19 Aug 2022 Completed Modimolle to Polokwane Yes 21 Oct 2022 Completed Beta to Modimolle Yes 21 Oct 2022 Completed Northern Cape Upington to Cape Town Yes 22 Sep 2022 Completed Kimberly to Cape Town Yes 05 Oct 2022 Completed Kimberly to Bloemfontein Yes 05 Oct 2022 Completed North West Mmabatho to Beta Yes 19 Oct 2022 Completed Mmabatho to Centurion Yes 19 Oct 2022 Completed Potchefstroom to Centurion Yes 27 Oct 2022 Completed Western Cape George to Pietermaritzburg Yes 27 Oct 2022 Completed SITA SOC Ltd 9

Expanding on Redundancy Expanding on Redundancy Over and above the initially identified problematic Core links, SITA has tasked LIT to provision the same level of redundancy on ALL Core links, the implementation of which is planned to be completed before 30 September 2023. SITA SOC Ltd 10

Expansion of Expansion of 10 Core 10 Core Links Links - - Implementation Plan Implementation Plan Description Description Commissioned Commissioned Installation date Installation date 1 Middelburg to BETA No 22-Sep 2023 2 Nelspruit to BETA No 22-Sep 2023 3 Nelspruit to Centurion No 22-Sep 2023 4 Bloemfontein to Cape Town No 22-Sep 2023 5 Bloemfontein to Centurion Yes 08 Sep 2023 6 Welkom to BETA No 22-Sep 2023 7 Worcester to George No 22-Sep 2023 8 Numerus to Centurion No 22-Sep 2023 9 Numerus to BETA No 22-Sep 2023 10 Mmabatho to Potchefstroom Yes 08 Sep 2023 SITA SOC Ltd 11

SITA Core Network Performance Statistics SITA Core Network Performance Statistics 01 April 2023 01 April 2023 31 August 2023 31 August 2023 SITA SOC Ltd 12

Redesign of the SITA Core Network Redesign of the SITA Core Network - - Target Layer 2 Transmission Architecture Target Layer 2 Transmission Architecture Introduction of National and Regional rings (DWDM/Metro Introduction of National and Regional rings (DWDM/Metro- -Ethernet) Ethernet) Full Redundancy Full Redundancy Improved Scalability Improved Scalability A Service Provider has been appointed to implement the target architecture, and contracting is currently being finalized. A Service Provider has been appointed to implement the target architecture, and contracting is currently being finalized. SITA SOC Ltd 13

EVOLUTION TO THE SOFTWARE DEFINED NETWORK SITA SOC Ltd 14

SITA NGN history SITA NGN history 2007/2008 2007/2008 Where it started? Where it started? 1 1 3 3 The future state of Network? The future state of Network? Current State of the Network Current State of the Network 2 2 The existing SITA Core network SITA is embarking on a network (known as the SITA NGN) was transformation programme to In 2015 SITA refreshed hardware to designed in 2007 and built in 2008 modernize its Core network to Cisco ASR9010 router. to fulfill requirements set out Software Defined Network There are still Cisco 7609 routers during that period. (SDN). that have remained on the network. At the time the following Overall Layer-2 topology remained hardware was deployed:- the same. 1. Cisco 7609 routers 2. Cisco 12000 series routers SITA SOC Ltd 15

What is a SDN? What is a SDN? What is SD What is SD- -WAN ? WAN ? SDN Controller Traditional Network device SDN managed Network device Overlay Tunnels Data Centre Data Centre Software Defined Networking (SDN) Software Defined Networking (SDN) is the segregation of the control plane control plane (which determines the way the traffic should be handled) and the data plane plane (which forwards the traffic based on decisions made by the control plane) based on incoming traffic parameters, such as the MAC address, IP address, and Virtual Local Area Network (VLAN) ID. . SD SD- -WAN WANis the specific application of SDN technology applied to WAN connections (broadband internet, 4G, LTE, MPLS). It connects enterprise networks connects enterprise networks including branch offices and data centers over large geographic distances. SD-WAN is a software software- -defined approach to managing the WAN and WAN services managing the WAN and WAN services. data defined approach to SITA SOC Ltd 16

Benefits of the SITA SDN Benefits of the SITA SDN o Centralized network provisioning: Centralized network provisioning: Provide a centralized view of the entire network, making it easier to centralize enterprise management and provisioning o Content Delivery Content Delivery: Controlling data traffic is one of the primary advantages of software defined networking. The ability to direct and automate data traffic makes implementing quality of services (QoS) for voice over IP (VOIP), video and audio transmissions much easier. o More granular security: More granular security: provides a central point of control to distribute security and policy information consistently throughout the enterprise. o Lower operating costs: Lower operating costs: SDN should lower overall operating costs and result in administrative savings since many of the routine network administration issues can be centralized and automated o Value Proposition: Value Proposition: accessibility to the SITA network and business services with a focus on quality, security and value for money and the ability to provision on demand bandwidth. the ability to provision on demand bandwidth. SITA SOC Ltd 17

Future SD Future SD- -WAN VPN Services WAN VPN Services SDN Controller Traditional Network device SDN managed Network device Overlay Tunnels Data Centre Data Centre Current Services on SITA MPLS Current Services on SITA MPLS SITA SOC Ltd 18

SITA SOC Ltd 19

SDN Implementation: Current Status SDN Implementation: Current Status Service Provider appointed on 06 December 2021 to implement the SDN Solution; Equipment has been distributed, installed and configured at 25 x SITA Switching Centres; Migration of the services from the legacy equipment is currently in progress, and is scheduled to be completed by 31 March 2024. SITA SOC Ltd 20

REMOTE ENVIRONMENTAL MANAGEMENT SOLUTION SITA SOC Ltd 21

Remote Environmental Management (REM) Solution Remote Environmental Management (REM) Solution REM Solution already implemented at 24 x SITA Switching Centres 2 x SITA Switching Centres outstanding (Observatory relocating to Deep River and Welkom new Switching Centre) SITA SOC Ltd 22

Environmental Management (REMS) Capabilities for SITA Environmental Management (REMS) Capabilities for SITA Video Control Video Control: SITA now has a flexible intelligent video surveillance solution to safeguard the Switching Centres which can be extended to do real-time anomaly detection, proactive notifications and capabilities across the entire SITA switching center deployment with one interface. Access Control Access Control: This AI system allows SITA to enter the Switching Centers through touchless face recognition, keypad with biometric in case that they forgot to their cards, offering keypad quick access to SITA and Support personnel. Additionally, another advantage of this system is that if someone attempts to enter with a fake photo or recorded video, the system will trigger an alarm, thus preventing suspicious people from entering the switching center. Environmental Management Environmental Management: Inferrix enables SITA to do Power Monitoring(UPS), Temperature and Air Condition , Water Leak Detection, Door access, Fire Control and Generator Management SITA SOC Ltd 23

INTERNET RESILIENCE AND IMPROVEMENT INITIATIVES SITA SOC Ltd 24

SITA SITA Internet Failover Internet Failover Internet tender specification for RFB 2109/2019 included a cross-country backhaul link Full solution deployment was slow because of delays in landing the required infrastructure The solution has now been fully implemented Primary links for both Centurion and Cape Town SITA breakout points go to local ISP PoPs (DD) Backhaul / Failover link runs between the 2 SITA PoPs via Teraco SITA Centurion to SITA Cape Town via Teraco at Isando and then Teraco at Rondebosch This architecture covers more failure / outage scenarios than duplicate local links would cover Extensive testing has been done with failures simulated at various points in the SITA/ISP network connectivity and failover was successfully triggered automatically Project was signed off on 31 March 2022 SITA SOC Ltd 25

SITA SITA Internet Failover Internet Failover Current configuration 30 Gbps out of each PoP Configuration ensures no service degradation to either client base if failover takes place Cape Town 20Gbps active; 10Gbps passive/reserved for Centurion failover if required Centurion: 10Gbps active; 20Gbps passive/reserved for Cape Town failover if required Backhaul: 20Gbps Contract allows for extensive scalability for service to be able to meet client requirements without delays SITA SOC Ltd 26

SITA Internet Failover Architecture SITA Internet Failover Architecture IP Transit IP Transit SITA SOC Ltd 27

Internet Peering Internet Peering Peering at NAP Africa Peering at NAP Africa Largest peering community in Africa Single Internet peering point to multiple ISPs 10gbps links to NAP Africa from both SITA PoPs planned Cape Town link deployed at 10gbps Centurion link in project phase Enables exchange of large volumes of traffic between Network Service Providers (NSPs) via public peering 100% peering, no membership/port fees Cost Reduction less reliance on expensive international bandwidth Improved customer experience due to reduced latency (from simplified routing and direct connections) Redundancy Scalability Resiliency - multiple network connections SITA SOC Ltd 28

APPENDIX APPENDIX "It always seems impossible until it is done." -Nelson Mandela SITA SOC Ltd 29

30 SITA Service Improvement Plan SITA Service Improvement Plan Progress to date Progress to date Critical Issues Critical Issues Short Short- -term Action Plans term Action Plans Comments Comments Timelines Timelines Status Status 1. The functionality of SITA The Remodeling of SITA is an ongoing project to review and enhance the functionality of SITA to become a digital services arm of government. The goal is to go back to SITA s original mandate. 31 March 2024 In progress a)Remodeling of SITA 2. Improve procurement turn-around- times & Reforms Automation of processes including enhancement of end-to-end ITSM and upgrades to the Oracle ERP Centre of Excellence (C0E) set up focusing on strengthening Specification development, Proposals development and market intelligence e-Procurement capability enhanced with an electronic publication tool for the market Use Request for Proposals (RFPs) rather than Requests for Bids (RFBs) to expedite procurement and service delivery as well as allow for sourcing flexibility Increased Delegation of Authority (DOA) to the regions/ provinces to exponentially reduce provincial demands at national for sub-R3 mil transactions 31 March 2024 In progress a) Accelerated Supply Chain Management Reforms Plan

31 SITA Service Improvement Plan SITA Service Improvement Plan Progress to date Progress to date Critical Issues Critical Issues Short Short- -term Action Plans term Action Plans Comments Comments Timelines Timelines Status Status Service-based approach to Broadband Connectivity Software Defined Network ready equipment in all 26 Switching Centres Stabilization of the Core Remote Environmental Management Solution Aircon, waterflows-ups Internet Resilience and Improvement Initiatives - done Completed a) Investment of R400 mil Capex towards IT Infrastructure modernization including: 3. IT Infrastructure Modernization Data-Centre Modernization and Rationalization/ Consolidation - partnerships with Industry and not re-invent wheel at exorbitant costs ongoing. Engagement with Telkom/BBI/Sentech commenced and task team instituted to finalise partnership implementation plan. 31 March 2024 In progress The Government Private Cloud Ecosystem ongoing project to revise operating model on cloud, value chain and adoption) Drive adoption and migration to secure SITA Cloud services- SITA Cloud business model being reviewed to enhance effectiveness and efficiency Energy security - risk management plan including improved UPS systems, diesel strategy and currently reviewing a Solar- power strategy in progress SDN programme and final phase completion Repository of government systems compiled and engagements with clients underway with Departments committed to systems modernization - done Completed a) Modernisation of legacy systems project 4. Obsolete Legacy Systems Few APIs already developed as a way of modernizing user interfaces and ensuring interoperability and integration whilst using legacy engines, and mainframe Ongoing into other financial years In progress

32 SITA Service Improvement Plan SITA Service Improvement Plan Progress to date Progress to date Critical Issues Critical Issues Short Short- -term Action Plans term Action Plans Comments Comments Timelines Timelines Status Status The review of 2008 ~ 2009 tariffs has been presented to SITA Board (includes printing, HR and networks tariffs) and approved for consultation with GITOC and other stakeholders. Completed a) Pricing Model and tariff reform 5. Tariffs and Pricing Review of Pricing models and building stronger market intelligence related to pricing underway 31 March 2024 In progress GITOC Consultation on Tariffs to be held during July 2023. Consultations with NT, DCDT and other stakeholders Partnerships with Suppliers resulted in Innovation Centres constructed to amongst others ensure training and skills development. Microsoft, Huawei and Software AG already set up these centres in partnership with SITA where training for SITA and Clients is happening at scale. Completed 6. ICT Skills development and Training a) Skills Development and partnership network Framework Agreements with OEM/ OSM reviewed to ensure training and skills development is happening, including of SMMEs ongoing/done WSP being reviewed to ensure skills programs are managed and focused on certain critical skills like Cloud as cornerstone of digital transformation - ongoing Partnerships with Academia for new graduated IT students and IP Commercialization for Innovators/ SMMEs 31 March 2024 In progress Additional Framework Agreements with OEM/ OSM being determined to ensure training and skills development.

33SITA Service Improvement Plan SITA Service Improvement Plan Progress to date Progress to date Short Short- -term Action term Action Plans Plans Critical Issues Critical Issues Comments Comments Timelines Timelines Status Status Re-engagements with the National Treasury on the resuscitation of the IFMS underway. SITA tasked to review the RFI response by Oracle ensuring risk mitigation, response is implementable, value for money and quality service Governance structure and cadence put in place to manage implementation. 31 March 2025 In progress 7. Implementation of IFMS a) IFMS Programme Assessment of Client pain-points and definition of problem areas finalised, including the development of collaborative solutions which are encapsulated in the service improvement plans Internal and External Client-facing PMOs have been established to align fully with Client concerns and pain-points. A Client Forum and Exco Client Committee has been set up to specifically focus on client matters MD has engaged FOSAD with Accounting Officers and has been meeting DGs individually to co-solution and innovate for service delivery Completed a) Service Improvement Plan 8. Client Centricity GITOC and PGITO fully engaged and continuous engagements planned to partner and solution together Engagements with Clients to understand their pain-points and co-create solutions which are encapsulated in the service improvement plans. 31 March 2024 In progress Issues related to the four line departments (DHA, DMRE, SAPS and DoJ & CD) are in progress. Governance structures agreed with the DGs of the 4 line Departments to maintain momentum and monitor implementation. 31 March 2024 In progress ICT SMME Industry Associations Engagement workshop took place in June 2023 to establish an engagement framework, develop key objectives, goals to pursue with measurable performance indicators. Completed a) SMME Developme nt Plan 9. Industry Transformation and Localisation Partnership model to win with Industry, SMMEs, Academia, youth and innovators to inter alia develop home-grown solutions. Development of a partnership model to achieve SITA and Client objectives Engagements with SMME, Industry partners, OEMs and other partners to solve client problems 31 March 2024 In progress b) Partnership Models with Industry