How to Synchronize EPPO Data with Log Shipping
undefined
How to synchronize
EPPO data with
LogShipping
Damien Griessinger – EPPO
2021-06-22
EPPO provides multiples files format
Bayer flat file
XML
XML datapacket
XML access
XML full
SQL
sqlLite database
It’s good
BUT
It’s not easy to update data
Download file
Compare
If change update
If missing insert
…
Log shipping
The log shipping is a technique to replicate database to another
database instance by copying and reload a transaction log file.
•
Actions are : Insert / Update / Delete
•
Log and Save actions on dedicated table (logs)
•
Replay actions on the same order on the remote system
Insert
name
Insert
name
Update
name
Insert
author
Insert
code
Insert
code
Delete
author
Update
author
t
0
t
n
Table
Names
Table
Authors
Table
Codes
Table
Logs
Insert name
update name
Insert name
Update name
Insert author
Delete author
Update author
Insert code
Insert code
Insert name
Update name
Insert name
Update name
Insert author
Insert code
Insert code
Delete author
Update author
EPPO Actions on the database
Automatic
trigger
Table
Logs
Table
Names
Table
Authors
Table
Codes
Insert name
Update name
Insert name
Update name
Insert author
Insert code
Insert code
Delete author
Update author
EPPO Server
User Server
Logshipping
Script
Steps to setup logshipping
•
Go to EPPO Data services Portal
https://data.eppo.int
•
Register (free) or login
•
Download logshipping packages
•
Create a token
•
This token allows you to connect on API
•
Unzip the package
•
Change setting in the script
•
Your database parameters
•
Your token
•
Generate the initial load
•
Script will generate SQL file depending of your database
•
Run the synchronisation script to test
•
Example in php is provided
•
If success
•
schedule the script to follows your needs
Thank you for your attention
EPPO provides multiple files in XML format, and it is challenging to update data in a SQLite database. Log shipping is a technique for replicating a database to another instance by copying transaction log files. Follow steps to set up log shipping on the EPPO Data services portal for efficient data synchronization.
Uploaded on Oct 08, 2024 | 1 Views
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
How to synchronize EPPO data with LogShipping Damien Griessinger EPPO 2021-06-22
EPPO provides multiples files format Bayer flat file XML It s good XML datapacket BUT XML access It s not easy to update data XML full SQL sqlLite database Download file Compare If change update If missing insert
Log shipping The log shipping is a technique to replicate database to another database instance by copying and reload a transaction log file. Actions are : Insert / Update / Delete Log and Save actions on dedicated table (logs) Replay actions on the same order on the remote system Update Update Insert Insert Insert Insert Insert author author author Delete name name name code code t0 tn
EPPO Actions on the database Automatic trigger Table Names Table Codes Table Logs Table Authors
Insert author Insert code Table Logs Insert name Insert code Delete author Update name Update author Insert name Update name Logshipping Script EPPO Server Table Names Table Authors Table Codes User Server
Steps to setup logshipping Go to EPPO Data services Portal https://data.eppo.int Register (free) or login Download logshipping packages Create a token This token allows you to connect on API Unzip the package Change setting in the script Your database parameters Your token Generate the initial load Script will generate SQL file depending of your database Run the synchronisation script to test Example in php is provided If success schedule the script to follows your needs
