Software

We develop technology for national harvesters.

LA Referencia, through its Technical Team, has developed a free and open-source software platform (GPL 3) for information harvesting that not only supports the central node of the regional network but also serves as an aggregator service and national portal for member countries. This technological solution originated during the pilot phase of the IDB project from March to September 2013. By mid-2014, with support from Science and Technology agencies, the need for a transferable solution with a set of technological enhancements was identified.

Since 2015, LA Referencia’s technology has been installed in:

  • Argentina (MINCYT)
  • Brasil (IBICT)
  • Colombia (Renata, Colciencia, Ministerio de Educación) 
  • Costa Rica (CONARE) 
  • Chile (CONICYT. LR Harvester y LR Provider)
  • Ecuador (CEDIA, SENECYT) 
  • El Salvador (CBUES, Viceministerio de CyT)
  • Perú (CONCYTEC)
  • Uruguay (ANII) 
  • Portugal (RCAAP)
  • Panamá (PRICILA)
The platform is composed of three components that work in coordination:

LRHarvester

Harvesting, Transformation, and Validation Component for OAI-PMH Metadata. This component is responsible for harvesting OAI sources, validating metadata records, and transforming them to comply with the network’s quality guidelines. The harvesting component was initially based on OCLCHarvester2. The platform is developed in Java 1.7, using the Spring framework and the PostgreSQL 9.X database engine. It is also compatible with MySQL.

LRProvider

This component is responsible for publishing metadata through the OAI-PMH protocol. It is currently based on the DSpace-XOAI software, which provides high flexibility and scalability for interoperability with other international metadata aggregators.

Search Engine / Service Portal:

This component provides a user-friendly, mobile-responsive search interface for accessing the aggregated metadata. In addition, it offers statistics on metadata quality and the progress of harvesting processes. The portal is based on the open-source software VuFind (http://vufind.org), with custom modules developed specifically for the platform.

Its latest version (3.0) includes improvements such as:

  • A more user-friendly and responsive admin interface.
  • Redesigned validation and transformation mechanism, enabling the implementation of rules that support more complex guidelines.
  • Expanded domain objects to represent and store validators, transformers, controlled vocabularies, and transformation dictionaries.
  • Redesigned relational structure for improved performance.
  • Enhanced storage of diagnostic details related to the Solr engine.
  • Redesigned diagnostics and reporting interface.
  • Multi-rule and multi-field validation, along with improved support for harvesting from OJS (Open Journal Systems).

The design principles defined in 2014–2015 remain valid.

  • Transferable: The central node version must be the same as the national nodes.
  • Responsive: Mobile device access supported (using Bootstrap)
  • Multilingual: Support at least in English and Portuguese.
  • Business-oriented: Focused on validation and transformation of metadata in OAI.
  • Support for OpenAIRE guidelines: Flexible enough to update with new guidelines.
  • Scalable: Must harvest hundreds of repositories and over one million records in less than 24 hours.
  • Manageable and user-friendly: Diagnostic, validation, and reporting tools for administrators. Usable by information specialists as well as IT technicians.
  • Open Source: Development and use of components and solutions (e.g., VuFind for the front end, and well-known databases such as MySQL, PostgreSQL, and Java as the programming language).
  • Statistics: Development of new modules.
  • Cost-effective: Based on free Linux distributions like Ubuntu, and for an average national node, requires a two-core machine with 8 GB RAM and 500 GB of storage.
Software and documentation are available in the GitHub repository.

You can contact the Brazilian authorities at the following link:

You can contact the Chilean authorities at the following link:

You can contact the Colombian authorities at the following link:

You can contact the Costa Rican authorities at the following link:

You can contact the Ecuadorian authorities at the following email address:

You can contact the Spanish authorities at the following email address:

You can contact the Panamanian authorities at the following email address:

You can contact the Peruvian authorities at the following link:

You can contact the Uruguayan authorities at the following link: