From Scientific Variables to Knowledge Graphs: The I-ADOPT Benchmark
has assertion: assertion
has provenance: provenance
has publication info: pubinfo
type: Nanopublication
created: 2026-05-11T15:57:56.804+02:00
creator: RoCrateBot
type: FAIRDigitalObject
type: RoCrateNanopub

Earth sciences
type: DefinedTerm

Corpus
date created: 2025-12-31 10:57:48.638315+00:00
date modified: 2025-12-31 10:57:49.356851+00:00
description: This is the version of the corpus used in the paper.
license: no-permission
sd date published: 2025-12-31 10:57:48.638315+00:00
type: Dataset
type: Resource
type: MediaObject

Source code repository for evaluation
date created: 2025-12-31 10:59:01.841725+00:00
date modified: 2025-12-31 10:59:02.523867+00:00
description: This repository contains the source code used to run the experiments and the results obtained.
license: no-permission
sd date published: 2025-12-31 10:59:01.841725+00:00
type: Resource
type: MediaObject
type: SoftwareApplication

Corpus repository
date created: 2025-12-31 10:54:57.270901+00:00
date modified: 2025-12-31 10:56:56.694242+00:00
description: In this repository you can find the TTL files of the corpus.
license: no-permission
sd date published: 2025-12-31 10:54:57.270901+00:00
type: Dataset
type: Resource
type: MediaObject

From Scientific Variables to Knowledge Graphs: The I-ADOPT Benchmark
about: Earth sciences
content size: 0
date created: 2025-12-31 10:52:28.470807+00:00
date modified: 2026-04-11 03:01:43.580973+00:00
date published: 2025-12-31 10:52:28.470807+00:00
description: This Research Objects contains the supplementary material of the paper "From Scientific Variables to Knowledge Graphs: The I-ADOPT Benchmark" sent to the Semantic Web Journal. This paper presents the I-ADOPT benchmark, an expert annotated corpus and task designed to measure the performance of LLMs in the different stages of automatically creating a machine readable scientific variable. Our corpus includes more than 100 scientific variables as structured knowledge graphs You can find in the Research Object the corpus, as well as the source code needed to execute the experiments, and the results of them.
encoding format: application/ld+json
has part: Corpus
has part: Source code repository for evaluation
has part: Corpus repository
keywords: I-ADOPT
keywords: LLM
keywords: corpus
keywords: scientific variables
license: no-permission
creation mode: MANUAL
type: ResearchObject
type: LiveRO
type: Dataset
cite-as: GONZALEZ GUARDIA, ESTEBAN. "From Scientific Variables to Knowledge Graphs: The I-ADOPT Benchmark." ROHub. Dec 31 ,2025. https://w3id.org/ro-id/52654482-5442-45ea-a4b7-80a9af510c0b.

Key Type Measures
type: FCID

No policy or regulation
type: FCID

Distributed Computing
type: FieldOfResearch

research
type: Lemma
norm score: 8.630952380952381
score: 5.8

Computer systems
type: NASA

Climate Hazard
type: FCID

benchmark
type: Concept
norm score: 10.21897810218978
score: 8.4

Engineering (General)
type: NASA

Climate-ADAPT Adaptation Sectors
type: FCID

graph
type: Lemma
norm score: 17.857142857142858
score: 12.0

Methodology
type: FCID

Numerical analysis
type: NASA

Academic/ Institutional
type: FCID

source code
type: Concept
norm score: 6.32603406326034
score: 5.2

none
type: FCID

Systemic Literature Review
type: FCID

Information and Computing Sciences
type: FieldOfResearch

Preparing the ground
type: FCID

research object
type: Phrase
norm score: 15.282791817087844
score: 12.7

Knowledge Sector (EEA)
type: FCID

European Continent
type: FCID

I-ADOPT
type: Organization

corpus
type: Concept
norm score: 8.090024330900244
score: 6.65

newspaper publisher
type: Concept
norm score: 4.5012165450121655
score: 3.7

variable
type: Lemma
norm score: 17.410714285714285
score: 11.7

I-ADOPT
type: Lemma
norm score: 22.023809523809522
score: 14.8

https://w3id.org/ro-id/enrichment/3c8ee510-6f25-4af6-aef4-99e6f7496bb3
name: This paper presents the I-ADOPT benchmark, an expert annotated corpus and task designed to measure the performance of LLMs in the different stages of automatically creating a machine readable scientific variable.
type: Sentence
norm score: 41.458106637649614
score: 38.1

Data Format
type: FieldOfResearch

knowledge
type: Lemma
norm score: 8.333333333333332
score: 5.6

Information Systems
type: FieldOfResearch

Engineering
type: NASA

Theoretical mathematics
type: NASA

expert annotated corpus
type: Phrase
norm score: 7.099879663056558
score: 5.9

corpus
type: Lemma
norm score: 12.797619047619047
score: 8.6

variable
type: Concept
norm score: 14.233576642335766
score: 11.7

Social and information sciences
type: NASA

none
type: FCID

Academia/ Research Institutions
type: FCID

research
type: Concept
norm score: 6.934306569343065
score: 5.7

material of the paper
type: Phrase
norm score: 6.257521058965102
score: 5.2

Documentation and information science
type: NASA

Other Mathematical Sciences
type: FieldOfResearch

task
type: Concept
norm score: 5.231143552311435
score: 4.3

Computer Software
type: FieldOfResearch

aim
type: Concept
norm score: 5.839416058394161
score: 4.8

IT-computer sciences
type: IPTC
path: Science and technology/Technology and engineering/IT-computer sciences

linguistics
type: Domain
norm score: 100.0
score: 8.8

Mathematical Sciences
type: FieldOfResearch

none
type: FCID

Our corpus includes more than 100 scientific variables as structured knowledge graphs
type: Sentence
norm score: 15.88683351468988
score: 14.6

Geographical Scope
type: FCID

I-ADOPT benchmark
type: Phrase
norm score: 44.4043321299639
score: 36.9

knowledge
type: Concept
norm score: 7.177615571776156
score: 5.9

Computer programming and software
type: NASA

Funding
type: FCID

Statistics and probability
type: NASA

Stakeholders
type: FCID

User Needs (RAST)
type: FCID

Science and technology
type: IPTC
path: Science and technology

Physical and Technological
type: FCID

none
type: FCID

material
type: Concept
norm score: 4.257907542579075
score: 3.5

Policy Scale
type: FCID

knowledge graph
type: Phrase
norm score: 26.955475330926593
score: 22.4

Mathematical and computer sciences (general)
type: NASA

benchmark
type: Lemma
norm score: 12.94642857142857
score: 8.7

Mathematical and computer sciences
type: NASA

experiment
type: Concept
norm score: 4.622871046228711
score: 3.8

IPCC
type: FCID

https://w3id.org/ro-id/enrichment/f7401b1a-2da5-47c3-bbe4-eabcb3cc8080
name: From Scientific Variables to Knowledge Graphs: The I-ADOPT Benchmark This Research Objects contains the supplementary material of the paper "From Scientific Variables to Knowledge Graphs: The I-ADOPT Benchmark" sent to the Semantic Web Journal.
type: Sentence
norm score: 42.6550598476605
score: 39.2

graph
type: Concept
norm score: 14.476885644768856
score: 11.9

Systems analysis and operations research
type: NASA

Computation Theory and Mathematics
type: FieldOfResearch

ESTEBAN GONZALEZ GUARDIA
type: Person
type: Agent

sig
has algorithm: RSA
signed by: RoCrateBot