Changes to the APEL Pub and Sync tests

Thank you for downloading the PAPYRUS quiz template to host a virtual quiz and support PAPYRUS. Your contributions can help fund life-saving resources for young individuals in need. Customize the template with your name, add questions for multiple rounds, and share the important message of preventing young suicide. Learn more about PAPYRUS, the national charity dedicated to preventing young suicide. Start your quiz and make a difference today!

• Charity
• Quiz Template
• Suicide Prevention
• Virtual Quiz
• PAPYRUS

dorm_wes Follow

Uploaded on Feb 24, 2025 | 0 Views

Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.

Presentation Transcript

1. Changes to the APEL Pub and Sync tests Stuart Pullinger OMB: 28thMay 2015 www.egi.eu EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number 654142

2. Outline GOCDB changes Rename services gLite-APEL APEL Or maybe remove completely Behaviour changes Pub test Per publisher not per site Sync test Per SubmitHost/CE not per site Insert footer here 2/24/2025 2

3. GOCDB changes: gLite-APEL gLite-APEL services DNs extracted Used for authorisation lists Message brokers Central repository Defined for host which is sending accounting data Can be ARC, QCG etc. Propose to change name to: eu.egi.grid.accounting.publisher Or just grid.accounting.publisher Insert footer here 2/24/2025 3

4. GOCDB changes: APEL APEL services Site, NGI/ROC, host extracted Used to create list for SYNC test Defined for host which receives grid job submissions All Cream CEs? Propose to change name to: eu.egi.grid.accounting.submithost Or just grid.accounting.submithost Insert footer here 2/24/2025 4

5. Current status: org.apel.APEL-Pub org.apel.APEL-Pub test Tests most recent publication date > 7 days ago: Warning > 31 days ago: Error How it works: For each SITE defining an APEL service Extract date of most recent job end time for the SITE Publish that date against each APEL service host for the SITE Which doesn t seem correct... Insert footer here 2/24/2025 5

6. Duplicated APEL test results Insert footer here 2/24/2025 6

7. Changes: org.apel.APEL-Pub Proposal: For each publisher + SITE combination in GOCDB Extract most recent job end time Publish different Pub status against each publisher for a SITE Consequences Sites with one publisher Test is against publisher service not APEL service Sites with several publishers eg. JURA + APEL A test per publisher rather than per site Sites who publish via another site Will no longer have a Pub test Affects NDGF, NGI_FRANCE, Africa/Arabia ROC Insert footer here 2/24/2025 7

8. Current status: org.apel.APEL-Sync org.apel.APEL-Sync test Tests whether number of records at site matches number at central repository difference < 10: OK difference < 100: Warning difference > 100: Error For sites sending Job Records from APEL client Also sends sync records number of records at site total per submit host, per month not sent by sites sending summaries not supported in ARC/Jura or QCG but could be Insert footer here 2/24/2025 8

9. Current status: org.apel.APEL-Sync How it works: For each SITE defining an APEL service Extract SITE total from sync records sent from site Extract SITE total from central repository Calculate difference and status Publish same SITE sync status against each APEL service host Which doesn t seem correct... Insert footer here 2/24/2025 9

10. Changes: org.apel.APEL-Sync Proposal For each submit host + SITE combination in GOCDB Extract submit host total from sync records sent from site Calculate submit host total from central repository Calculate difference and status Publish different sync status against each submit host for a SITE Consequences Administrators will have a better idea which system is not publishing correctly Insert footer here 2/24/2025 10

11. Or remove APEL service altogether If grid.accounting.publisher service defines Pub test (ie. does not use APEL services) And we want all Production + Monitored submit hosts to have a sync test We can delete the APEL service from GOCDB and use CE (40) CREAM-CE (538) gLite-CE (2) unicore6.Gateway? ARC-CE (110) QCG.Broker? dg.CREAM-CE (1) Submit hosts not sending sync records would have a status of Unknown Insert footer here 2/24/2025 11

12. Conclusion GOCDB changes Rename services gLite-APEL becomes grid.accounting.publisher APEL becomes grid.accounting.submithost Or maybe remove completely Behaviour changes Pub test Per publisher not per site Sync test Per submit host/CE not per site Insert footer here 2/24/2025 12

13. Thank you for your attention. Questions? www.egi.eu This work by Parties of the EGI-Engage Consortium is licensed under a Creative Commons Attribution 4.0 International License.