Data Import End-of-Life Transition and Future Plans
"Explore the journey of Data Import from its inception to the upcoming transition to the Ed-Fi Exchange, understanding its impact on the education community and the considerations for a smooth transition. Learn about the challenges, solutions, and the roadmap ahead."
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Data Import: Where do we go from here? Steven Arnold Ed-Fi Alliance
Agenda What is Data Import What is Data Import End of Life for Data Import Where do we go from here? Discussion
What is Data Import? Data Import is a web-based application that allows users to load CSV based data into the Ed-Fi API Originally designed to offer a no or low code approach for programmatic, non- technical people to import data into the ODS/API
What is Data Import? Data Import helped many smaller LEA s load assessment data into Ed-Fi, through it s easy to use interface and template sharing library allowing districts to share maps Data Import has also been used in: Larger LEA s Educator Preparation Programs SEA s Data Import was not designed to provide the data throughput and features that states need
End of life for an Ed-Fi project? Generally, we publish a notice on TechDocs a year or so in advance letting the community know what will happen After the EOL date we move the code to the Ed-Fi Exchange, so the code is still open source and available to the community But it receives no further updates or support from the Alliance. The biggest problem with this process is that nobody sees the announcements and the actual EOL surprises the community, leaving them confused
End of Life Data Import We originally published a notice in December that would have sent Data Import to the Ed-Fi Exchange December 2024 Data Import Transitioning to Ed-Fi Exchange Since everything we as a community do revolves around school years, we adjusted this to June 2025 After discussing with advocates within Ed-Fi and the members of community that rely on Data Import to function, we realized our current EOL plans would not support the community appropriately
End of Life Data Import Data Import will transition to the Ed-Fi Exchange in July 2026 instead of July 2025 In Addition: We ve done research on some replacements Loading Large Datasets - Alternatives to the Ed-Fi Data Import Tool Creating documentation with step-by-step examples of how to transition from Data Import Reach out to active data import users directly to discuss options
EarthMover and Lightbeam A set of open-source tools from Education Analytics Earthmover extracts and transforms CSV data into JSON Lightbeam loads the data into Ed-Fi Pros: Written in Python Similar import performance as Data Import Much more capable transform capabilities Pre-built assessment loaders available Cons: Lack of GUI means a bit more code wrangling
n8n An easy-to-use workflow automation tool Open source for non-commercial enterprises Graphical mapping with Node based concepts Connectors to retrieve data from: CSV s Databases API s AWS Many more Can use JS or Python for more control of the ETL process
Thank You! Presenter Organization @xhandle
